Image pickup control apparatus, image pickup control method and computer readable medium for changing an image pickup mode

ABSTRACT

An image pickup control apparatus, includes: a trigger acceptance section adapted to accept a predetermined trigger input as a changeover input from an automatic image pickup mode to a request responding image pickup mode; and a request responding image pickup control section adapted to establish, when the trigger input is accepted by the trigger acceptance section while an image pickup apparatus is carrying out still picture image pickup operation with an image pickup visual field of the image pickup apparatus changed in the automatic image pickup mode, the request responding image pickup mode and control the image pickup apparatus to execute a process for determining an image pickup visual field in accordance with an image pickup request and then execute still picture image pickup operation after the determination of the image pickup visual field.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.12/951,544, filed Nov. 22, 2010, and claims priority under 35 U.S.C. 119to Japanese Application Nos. 2009-297171, filed Dec. 28, 2009 and2009-297173, filed Dec. 28, 2009, the entire contents of which arehereby incorporated by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

This invention relates to an image pickup control apparatus and an imagepickup control method for an image pickup apparatus and an image pickupsystem wherein the image pickup visual field is automatically varied tocarry out image pickup. The present invention relates also to a programfor implementing the image pickup control apparatus and the image pickupcontrol method.

2. Description of the Related Art

An image pickup system is already known which includes a digital stillcamera and a camera platform which electrically varies the pan-tiltdirections of the digital still camera. Further, a technique of carryingout automatic composition adjustment and automatic recording of a pickedup image obtained by the composition adjustment is known and disclosedin Japanese Patent Laid-Open No. 2009-100300 (hereinafter referred to asPatent Document 1).

According to the technique disclosed in Patent Document 1, for example,a face detection technique is used to carry out search for an imagepickup object as a person. In particular, while the digital still camerais rotated in the pan direction by the camera platform, detection of animage pickup object, that is, of the face of a person, reflected in apicture range is carried out.

Then, if an image pickup object is detected in the picture range as aresult of such search for an image pickup object, then decision of anoptimum composition in accordance with a detection form of the imagepickup object such as, for example, the number, position, size and soforth of image pickup objects, within the picture range at the point oftime is carried out (optimum composition decision). In short, angles forpan, tilt and zoom operations which are estimated to be optimum aredetermined.

Further, after the optimum angles for pan, tilt and zoom operations aredetermined by the optimum composition decision in this manner,adjustment of the pan, tilt and zoom angles is carried out using thedetermined angles as target angles (composition adjustment).

After completion of the composition adjustment, automatic recording of apicked up image is carried out.

With automatic image pickup operation by such automatic compositionadjustment, that is, with picked up image automatic recording by suchautomatic composition adjustment, the necessity for any manual operationfor image pickup by the user is eliminated, and recording of a picked upimage of an optimum composition can be carried out automatically.

SUMMARY OF THE INVENTION

Incidentally, automatic image pickup which does not demand a cameramanis advantageous in that, since a user is not conscious of a cameraman,for example, in a party, an image of a natural expression or form can bepicked up. On the other hand, some user may desire to be photographed ina conscious expression or form thereof. For example, a user may desireto be photographed in a commemorative photograph, in a form when ittakes a pose to the camera or in an expression in which it is consciousof the image pickup.

Usually, where a cameraman holds a camera to pick up a still picture,users who want to have a photograph of them taken will call a cameraman,ask the cameraman to take a photograph of them and gather together ortake a pose.

However, only if such automatic image pickup as described above iscarried out, photographing or still picture image pickup which satisfiessuch a demand of a user or users cannot be carried out.

Therefore, it is desirable to provide an image pickup system whichcarries out automatic image pickup and can readily implement stillpicture image pickup in accordance with a demand of a user.

According to an embodiment of the present invention, there is providedan image pickup control apparatus including a trigger acceptance sectionadapted to accept a predetermined trigger input as a changeover inputfrom an automatic image pickup mode to a request responding image pickupmode, and a request responding image pickup control section adapted toestablish, when the trigger input is accepted by the trigger acceptancesection while an image pickup apparatus is carrying out still pictureimage pickup operation with an image pickup visual field of the imagepickup apparatus changed in the automatic image pickup mode, the requestresponding image pickup mode and control the image pickup apparatus toexecute a process for determining an image pickup visual field inaccordance with an image pickup request and then execute still pictureimage pickup operation after the determination of the image pickupvisual field.

Preferably the image pickup control apparatus further includes a pickedup image recording control section adapted to control the still pictureimage pickup operation of the image pickup apparatus which carries outimage pickup of an image pickup object and recording of picked up imagedata on or into a recording medium, an image pickup visual fieldvariation section adapted to change the image pickup visual field of theimage pickup apparatus, an image pickup visual field variation controlsection adapted to control the image pickup visual field variationsection, and an image pickup preparation processing section adapted tocarry out a process of determining an image pickup visual field forstill picture image pickup, the request responding image pickup controlsection being operable to control, when the trigger input is accepted bythe trigger acceptance section while the image pickup apparatus iscarrying out still picture image pickup under the control of the pickedup image recording control section while the image pickup visual fieldvariation control section controls the image pickup visual fieldvariation section in the automatic image pickup mode, the image pickuppreparation processing section to execute a process of determining animage pickup visual field in accordance with the image pickup request inthe request responding image pickup mode and cause a still picture imagepickup operation to be executed under the control of the picked up imagerecording control section after the determination of the image pickupvisual field.

Further preferably, the image pickup control apparatus further includesan image pickup prediction operation control section adapted to controlexecution of a prediction operation for predicting that still pictureimage pickup will be carried out, the request responding image pickupcontrol section being operable to control the image pickup preparationprocessing section to execute a process for determining an image pickupvisual field for a request responding image pickup operation in therequest responding image pickup mode, control, after the determinationof the image pickup visual field, the prediction operation to beexecuted under the control of the image pickup prediction operationcontrol section and then cause the still picture image pickup operationto be executed under the control of the picked up image recordingcontrol section.

The trigger acceptance section may accept a particular operation inputby a user, for example, touch operation by the user to the touch sensorsection, a particular sound input as the trigger input or that aparticular image pickup object state is decided from a picked up imageas the trigger input.

In the request responding image pickup mode, the image pickuppreparation processing section may carry out an image pickup objectdetection process for moving an image pickup object in accordance withthe image pickup request into the image pickup visual field while theimage pickup visual field variation control section controls the imagepickup visual field variation section.

Or, in the request responding image pickup mode, the image pickuppreparation processing section may carry out a composition process ofadjusting the arrangement of an image pickup object image in the imagepickup visual field while the image pickup visual field variationcontrol section controls the image pickup visual field variationsection. In this instance, the composition process may include a processof further moving, when one or more image pickup objects are detected inthe image pickup visual field, the image pickup visual field to confirmpresence of some other image pickup object in accordance with the imagepickup request.

Or, the image pickup preparation processing section may carry out thecomposition process also in the automatic image pickup mode but carryout, in the request responding image pickup mode, the compositionprocess in a processing procedure or with a processing parameterdifferent from that in the automatic image pickup mode.

According to another embodiment of the present invention, there isprovided an image pickup control method for an image pickup apparatus oran image pickup system which includes a still picture image pickupsection for carrying out image pickup of an image pickup object andrecording of picked up image data on or into a recording medium, and animage pickup visual field variation section for an image pickup visualfield of the still picture image pickup section, including the steps ofcausing the still picture image pickup section to execute a stillpicture image pickup operation while the image pickup visual fieldvariation section is controlled in an automatic image pickup mode,accepting a predetermined trigger input as a changeover input from theautomatic image pickup mode to a request responding image pickup mode,determining an image pickup visual field in accordance with an imagepickup request in the request responding image pickup mode, and causinga still picture image pickup operation to be executed by the stillpicture image pickup section after the determination of the image pickupvisual field.

According to a further embodiment of the present invention, there isprovided a program for causing a processor to control the image pickupapparatus or image pickup system described above, which includes stepssame as those of the image pickup control method.

In the image pickup control apparatus, image pickup control method andprogram, while the image pickup apparatus or image pickup systemautomatically controls the image pickup visual field variation sectionto vary the image pickup visual field, it executes still picture imagepickup operation. The operation in the automatic image pickup mode isexecuted independently of the will or demand of the user. The user canrequest image pickup by carrying out a predetermined trigger inputduring the operation in the automatic image pickup mode. The imagepickup operation in accordance with the trigger input is operation inthe request responding image pickup mode.

In the request responding image pickup mode, an image pickup visualfield in accordance with the image pickup request is determined. Forexample, operation wherein the user who has carries out the triggerinput is determined as an image pickup object is carried out. Then,after such determination of an image pickup visual field, still pictureimage pickup operation is executed automatically. At this time, if aprediction operation predicting that still picture image pickup will becarried out is carried out, then the user can easily make an expressionor take a pose.

In short, according to the image pickup operation, “image pickup basedon a will of a cameraman” in an ordinary case in which a cameraman picksup an image and “image pickup based on a demand from a user” can beexecuted in the automatic image pickup mode and the request respondingimage pickup mode, respectively.

With the image pickup control apparatus, image pickup control method andprogram, by image pickup in the automatic image pickup mode, an image ofa natural expression, form, scene and so forth can be picked up. Inaddition, by image pickup in the request responding image pickup mode,image pickup in accordance with a demand of the user can be carried out.Consequently, while no cameraman is demanded, various manners of imagepickup equivalent to those where a cameraman carries out image pickupcan be achieved.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1A and 1B are a front elevational view and a rear elevationalview, respectively, of a digital still camera which is a component of animage pickup system to which the present embodiment is applied;

FIG. 2 is a perspective view of a camera platform which is anothercomponent of the image pickup system;

FIG. 3 is a front elevational view showing the digital still cameraattached to the camera platform;

FIG. 4 is a schematic top plan view illustrating a movement in the pandirection in the state in which the digital still camera is attached tothe camera platform;

FIGS. 5A and 5B are side elevational views illustrating a movement inthe tilt direction in the state in which the digital still camera isattached to the camera platform;

FIG. 6 is a rear elevational view of the camera platform;

FIGS. 7A and 7B are top plan views showing different touch sensorsections of the camera platform;

FIG. 8 is a block diagram showing an example of an internalconfiguration of the digital still camera;

FIG. 9 is a block diagram showing an example of an internalconfiguration of the camera platform;

FIG. 10 is a block diagram showing a configuration of control functionsof the digital still camera and the camera platform;

FIGS. 11A and 11B are flow charts illustrating different automatic imagepickup processes of the image pickup system;

FIG. 12 is a flow chart illustrating an image pickup control processaccording to a first embodiment of the present invention;

FIG. 13 is a flow chart illustrating a modification to the image pickupcontrol process wherein pan-tilt operations in requested directions arecarried out;

FIG. 14 is a flow chart illustrating another modification to the imagepickup control process wherein image pickup object detection is notcarried out;

FIGS. 15 and 16 are flow charts illustrating further modifications tothe image pickup control process wherein a composition process is notcarried out;

FIG. 17 is a flow chart illustrating a still further modification to theimage pickup control process wherein a picked up image presentationprocess is carried out;

FIGS. 18 and 19 are diagrammatic views illustrating a basic compositionprocess;

FIGS. 20A and 20B are diagrammatic views illustrating a target range inthe composition process;

FIGS. 21A and 21B are diagrammatic views illustrating arrangement of thecenter of gravity in the target range in the composition process;

FIGS. 22, 23A and 23B are diagrammatic views illustrating a localsolution and the best solution in the composition process;

FIGS. 24A and 24B are diagrammatic views illustrating tentativecomposition adjustment;

FIGS. 25A and 25B are diagrammatic views illustrating regularcomposition adjustment after the tentative composition adjustment;

FIGS. 26A and 26B are diagrammatic views illustrating target ranges inthe tentative composition adjustment;

FIGS. 27A and 27B are flow charts illustrating composition processes inan automatic image pickup mode and a request responding image pickupmode, respectively;

FIGS. 28A and 28B are flow charts illustrating processes for thetentative composition adjustment and the regular composition adjustment,respectively;

FIG. 29 is a flow chart of an image pickup control process according toa second embodiment of the present invention;

FIG. 30 is a flow chart of an image pickup control process according toa third embodiment of the present invention;

FIGS. 31 to 34 are block diagrams showing different configurations ofcontrol functions of the digital still camera and the camera platform;and

FIGS. 35A and 35B are block diagrams showing a basic configuration ofcontrol functions of the digital still camera and the camera platform,respectively.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

In the following, preferred embodiments of the present invention aredescribed in detail in the following order. In the embodiments, thepresent invention is applied to an image pickup apparatus or imagepickup system which includes a digital still camera and a cameraplatform.

-   1. Configuration of the Image Pickup System

1-1. General Configuration

1-2. Digital Still Camera

1-3. Camera Platform

-   2. Example of the Functional Configuration-   3. Automatic Image Pickup Process-   4. Image Pickup Operation of the First Embodiment-   5. Modifications to the First Embodiment

5-1. Trigger to the Request Responding Image Pickup Mode

5-2. Pan-Tilt to the Requested Direction

5-3. Example Wherein Image Pickup Object Detection Is Not Executed inthe Request Responding Image Pickup Mode

5-4. Example Wherein a Composition Process Is Not Executed in theRequest Responding Image Pickup Mode

5-5. Picked Up Image Presentation in the Request Responding Image PickupMode

5-6. Tentative Composition Process

5-7. Control Method in a Different Request Responding Image Pickup Mode

-   6. Image Pickup Operation of the Second Embodiment-   7. Image Pickup Operation of the Third Embodiment-   8. Image Pickup Operation of the Fourth Embodiment-   9. Modifications to the Functional Configuration-   10. Program

It is to be noted that, while the terms “picture range,” “view angle,”“image pickup visual field” and “composition” are used in the presentspecification, they are individually defined in the following manner.

The term “picture range” is a range of a region corresponding to onescreen in which, for example, an image looks fitted, and generally hasan outer frame shape of a vertically or horizontally elongatedrectangle.

The “view angle” is normally called zoom angle or the like and is arepresentation by an angle of a range included in the picture rangewhich depends upon the position of a zoom lens in an optical system ofan image pickup apparatus. Although it is generally considered that theview angle depends upon the focal distance of the image pickup opticalsystem and the size of an image surface, that is, an image sensor or afilm, a factor which can vary in response to the focal distance isreferred to herein as view angle.

The term “image pickup visual field” represents a visual field by animage pickup optical system. In other words, the image pickup visualfield is a range of a peripheral sight of the image pickup apparatuswithin which the peripheral sight is held as an image pickup objectwithin the picture range. The image pickup visual field depends upon aswinging angle in the pan direction, that is, in the horizontaldirection and an angle in the tilt direction, that is, in the verticaldirection, or in other words, defined by an elevation angle and adepression angle.

The term “composition” is referred to also as framing and represents anarrangement state of an image pickup object in the picture range, whichdepends, for example, upon the image pickup visual field, including sizesettings of the image pickup object.

1. Configuration of the Image Pickup System

1-1. General Configuration

Referring first to FIGS. 1A and 1B, there is shown an image pickupsystem to which the present invention is applied. The image pickupsystem includes a digital still camera 1 and a camera platform 10removably attached to the digital still camera 1.

An appearance of the digital still camera 1 is shown in FIGS. 1A and 1B.Particularly, a front elevation and a rear elevation of the digitalstill camera 1 are shown in FIGS. 1A and 1B, respectively.

The digital still camera 1 includes a lens section 21 a provided on thefront side of a main body section 2 as seen in FIG. 1A. The lens section21 a is an element of an optical system for image pickup which isexposed to the outer side of the main body section 2.

A release button 31 a is provided on an upper face of the main bodysection 2. In the image pickup mode, an image picked up by the lenssection 21 a, that is, a picked up image, is generated as an imagesignal. In the image pickup mode, picked up image data for each frameare obtained at a predetermined frame rate by an image sensorhereinafter described.

If an operation for the release button 31 a is carried out, that is, ifa release operation/shutter operation is carried out, then a picked upimage, that is, a frame image, at this timing is recorded as image dataof a still image into a recording medium. In other words, still imagepickup normally called photographing is carried out.

The digital still camera 1 further has a display screen section 33 a onthe rear face side thereof as shown in FIG. 1B.

In the image pickup mode, an image called through-picture or the likewhich is an image being currently picked up by the lens section 21 a isdisplayed on the display screen section 33 a. The through-picture is amoving picture based on frame images obtained by the image sensor and isan image representing an image pickup object at the time as it is.

On the other hand, in a reproduction mode, image data recorded in therecoding medium are reproduced and displayed.

Further, in response to an operation carried out for the digital stillcamera 1 by a user, an operation image as a GUI (Graphical UserInterface) is displayed on the display screen section 33 a.

Further, if a touch panel is combined with the display screen section 33a, then the user can carry out necessary operation by touching thedisplay screen section 33 a with a finger thereof.

It is to be noted that, though not shown, the digital still camera 1 mayinclude various operation elements such as keys and dials in addition tothe release button 31 a.

Further, the digital still camera 1 may include a sound collectingelement as a sound inputting section 35 hereinafter described, an LEDlight emitting section as a release prediction execution section 36, aspeaker section and so forth.

FIG. 2 shows an appearance of the camera platform 10. Further, FIGS. 3to 5B show, as an appearance of the image pickup system, the digitalstill camera 1 placed in an appropriate state on the camera platform 10.FIG. 3 shows a front elevational view, FIG. 4 shows a top plan view, andFIGS. 5A and 5B show side elevational views, particularly, FIG. 5Billustrates a range of movement of the digital still camera 1 by a tiltmechanism hereinafter described.

Referring to FIGS. 2 to 5B, the camera platform 10 is roughly structuredsuch that a main body portion 11 is combined with and provided on aground stand portion 15 and a camera pedestal portion 12 is attached tothe main body portion 11.

In order to attach the digital still camera 1 to the camera platform 10,the digital still camera 1 is placed at the bottom face side thereof onthe upper face side of the camera pedestal portion 12.

Referring particularly to FIG. 2, a projection 13 and a connector 14 areprovided on the upper face of the camera pedestal portion 12. Though notshown, a hole for engaging with the projection 13 is formed on the lowerface of the main body section 2 of the digital still camera 1. In astate wherein the digital still camera 1 is placed appropriately on thecamera pedestal portion 12, the hole and the projection 13 are engagedwith each other. In this state, when ordinary pan and tilt movements ofthe camera platform 10 are carried out, such a situation that thedigital still camera 1 is displaced on or removed from the cameraplatform 10 does not occur.

Further, in the digital still camera 1, a connector is provided also ata predetermined position of the lower face thereof. In the state inwhich the digital still camera 1 is attached appropriately to the camerapedestal portion 12 as described above, the connector of the digitalstill camera 1 and the connector 14 of the camera platform 10 areconnected to each other thereby to allow communication at least betweenthe digital still camera 1 and the camera platform 10.

It is to be noted that, for example, the connector 14 and the projection13 actually can change or move the positions thereof within a certainrange on the camera pedestal portion 12. For example, if an adaptercompatible with the shape of the bottom face of the digital still camera1 or a like element is used additionally, then different types ofdigital still cameras can be attached to the camera pedestal portion 12for communication with the camera platform 10.

Now, basic movements of the digital still camera 1 in pan and tiltdirections by the camera platform 10 are described.

First, basic movements of the digital still camera 1 in the pandirection are described.

In a state in which the camera platform 10 is placed, for example, on atable or on the floor, the bottom face of the ground stand portion 15contacts with the table or the floor. In this state, the main bodyportion 11 side can rotate in the clockwise direction and thecounterclockwise direction around a rotation axis 11 a as seen in FIG.4. Consequently, the image pickup visual field in the horizontaldirection, that is, in the leftward and rightward direction, of thedigital still camera 1 attached to the camera platform 10 can be carriedout thereby. In other words, panning can be carried out.

It is to be noted that the pan mechanism of the camera platform 10 inthis instance is structured such that rotation by more than 360° can becarried out freely without any limitation with regard to both of theclockwise direction and the counterclockwise direction.

Further, the pan mechanism of the camera platform 10 has a referenceposition determined with regard to the pan direction.

It is assumed here that the pan reference position is represented by 0°or 360° and the rotational position of the main body portion 11 alongthe pan direction, that is, the pan position or pan angle, isrepresented by 0° to 360°.

Basic movements of the camera platform 10 in the tilt direction arecarried out in the following manner.

A movement of the camera platform 10 in the tilt direction is obtainedby swinging the angular position of the camera pedestal portion 12 inthe opposite directions to an elevation angle and a depression anglearound a pivot axis 12 a as seen in FIGS. 5A and 5B.

FIG. 5A particularly shows the camera pedestal portion 12 at a tiltreference position Y0 which is 0°. In this state, an image pickupdirection F1 which coincides with an image pickup optical axis of thelens section 21 a of the optical system section and a ground faceportion GR with which the ground stand portion 15 contacts extend inparallel to each other.

From this state, the camera pedestal portion 12 can move, toward theelevation angle direction, within a range of a predetermined maximumrotational angle +f° from the tilt reference position Y0 of 0° aroundthe pivot axis 12 a as seen in FIG. 5B. On the other hand, also towardthe depression angle direction, the camera pedestal portion 12 can movewithin a range of a predetermined maximum rotational angle −g° from thetilt reference position Y0 of 0°.

Since the camera pedestal portion 12 moves within the range from themaximum rotational angle +f° to the maximum rotational angle −g° withreference to the tilt reference position Y0 of 0° in this manner, theimage pickup visual field in the tilt direction, that is, in the upwardand downward direction, of the digital still camera 1 attached to thecamera platform 10, that is, to the camera pedestal portion 12, can bevaried. In other words, a tilt movement is obtained.

FIG. 6 shows a rear face of the camera platform 10.

Referring to FIG. 6, the camera platform 10 has a power supply terminalsection t-Vin and a video terminal section t-Video formed on a rear faceof the main body portion 11 thereof. To the power supply terminalsection t-Vin, a power supply cable is removably connected, and to thevideo terminal section t-Video, a video cable is removably connected.

The camera platform 10 supplies electric power input thereto through thepower supply terminal section t-Vin to the digital still camera 1attached to the camera pedestal section 12 described hereinabove tocharge the digital still camera 1.

In short, the camera platform 10 functions also as a cradle or dock forcharging the digital still camera 1.

Further, the camera platform 10 is configured such that, when an imagesignal, for example, based on a picked up image is transmitted from thedigital still camera 1 side, the camera platform 10 outputs the imagesignal to the outside through the video terminal section t-Video.

Further, as shown also in FIG. 6 and FIG. 4, a menu button 60 a isprovided on the rear face of the main body portion 11 of the cameraplatform 10. If the menu button 60 a is operated, then a menu screenimage is displayed, for example, on the display screen section 33 a sideof the digital still camera 1 through communication between the cameraplatform 10 and the digital still camera 1. Through the menu screenimage, the user can carry out demanded operation.

Incidentally, in a form of the image pickup system, a touch operation ofa user is adopted as one of triggers for triggering operation of arequest responding image pickup mode hereinafter described.

In particular, the user would carry out an operation of touching thecamera platform 10. To this end, a touch region 60 b is formed on theupper face of the main body portion 11, for example, as shown in FIG.7A. When the user touches the touch region 60 b, a touch sensor providedon the camera platform 10 detects the touch operation.

It is to be noted that, while a region of the front face side indicatedby a broken line is determined as the touch region 60 b, for example,the overall area of the upper face of the main body portion 11 mayotherwise be determined as the touch region 60 b.

FIG. 7B shows an example of the upper face of the main body portion 11of the camera platform 10 on which touch regions 60 b, 60 c and 60 d areprovided at a front side portion, a right side portion and a left sideportion, respectively. For example, three touch sensors may be providedin the camera platform 10 such that touching operations with the touchregions 60 b, 60 c and 60 d may be detected by the corresponding touchsensors.

In this instance, depending upon by which one of the touch sensors atouch operation is detected, the image pickup system side including thedigital still camera 1 and the camera platform 10 can decide from whichone of the forward, rightward and leftward directions the touchoperation is carried out by the user.

While the arrangement wherein three touch regions 60 b to 60 d areprovided is shown as an example in FIG. 7B, naturally a greater numberof touch sensors may be provided in a greater number of regions so thatthe direction in which a touching operation is carried out can bedecided more finely.

Further, though not shown, the camera platform 10 may additionallyinclude a sound inputting section having a microphone and a soundinputting circuit system like a sound inputting section 62 hereinafterdescribed.

Further, the camera platform 10 may include an image pickup sectionincluding an image pickup lens, an image sensor, a picked up imagesignal processing system and so forth like an image pickup section 63hereinafter described.

Furthermore, the camera platform 10 may include a light emittingindication section of an LED or the like, a display section in the formof a liquid crystal panel, a sound outputting section including aspeaker, a sound outputting circuit and so forth like a releaseprediction execution section 64 hereinafter described.

Such various sections mentioned are hereinafter described one by one.

1-2. Digital Still Camera

FIG. 8 shows an example of an internal configuration of the digitalstill camera 1.

Referring to FIG. 8, an optical system section 21 includes apredetermined number of lens groups for image pickup including, forexample, a zoom lens and a focusing lens, a diaphragm and so forth. Theoptical system section 21 forms an image of light incident thereto asimage pickup light on a light receiving face of an image sensor 22.

The optical system section 21 further includes driving mechanical unitsfor driving the zoom lens, focusing lens and diaphragm described aboveand associated elements. Operation of the driving mechanical units iscontrolled by camera control such as zoom or view angle control,automatic focusing control and automatic exposure control which areexecuted, for example, by a control section 27.

The image sensor 22 carries out photoelectric conversion of convertingimage pickup light obtained by the optical system section 21 into anelectric signal. To this end, the image sensor 22 receives the imagepickup light from the optical system section 21 by means of the lightreceiving face of a photoelectric conversion element and successivelyoutputs signal charge accumulated in response to the intensity of thereceived light at predetermined timings. Consequently, an electricsignal corresponding to the image pickup light, that is, a picked upimage signal, is output.

It is to be noted that, although the photoelectric conversion element orimage pickup element adopted as the image sensor 22 is not limitedparticularly, under the existing circumstances, for example, CMOS(Complementary Metal Oxide Semiconductor) sensors, CCD (Charge CoupledDevice) sensors and like sensors are available. Where a CMOS sensor isadopted, a device or part which corresponds to the image sensor 22 maybe structured including an analog-digital converter which corresponds toan A/D converter 23 described below.

The picked up image signal output from the image sensor 22 is input tothe A/D converter 23, by which it is converted into a digital signal.The digital signal is input to a signal processing section 24.

The signal processing section 24 is configured, for example, from a DSP(Digital Signal Processor) and carries out predetermined signalprocessing in accordance with a program for the digital picked up imagesignal output from the A/D converter 23.

The signal processing section 24 fetches the digital picked up imagesignal output from the A/D converter 23 in a unit corresponding to onestill picture, that is, one frame image. Then, the signal processingsection 24 carries out predetermined signal processing for the picked upimage signal fetched in a unit of a still picture to generate picked upimage data or picked up still image data which are image signal datacorresponding to one still picture.

Further, the signal processing section 24 sometimes utilizes the pickedup image data acquired in this manner to execute an image analysisprocess for an image pickup object detection process or a compositionprocess hereinafter described.

In order to record the picked up image data generated by the signalprocessing section 24 in such a manner as described above as imageinformation into a memory card 40 as a recording medium, the picked upimage data corresponding, for example, to one still picture are outputfrom the signal processing section 24 to an encoding/decoding section25.

The encoding/decoding section 25 executes, for the picked up image datain a unit of a still picture output from the signal processing section24, compression encoding in accordance with a predetermined stillpicture compression encoding method and then adds a header and so forthto the resulting picked up image data, for example, under the control ofa control section 27 to convert the picked up image data into image dataof a predetermined compressed form. Then, the image data produced inthis manner are transferred to a medium controller 26.

The medium controller 26 writes and records the image data transferredthereto into the memory card 40 under the control of the control section27. The memory card 40 in this instance is a recording medium configuredsuch that it has an outer profile of a card type formed, for example, incompliance with predetermined standards and internally has a nonvolatilesemiconductor storage device such as a flash memory.

It is to be noted that the recording medium for recording image data maybe different in type, form and so forth from the memory card describedabove. It is possible to adopt various recording media such as, forexample, an optical disk, a hard disk, a semiconductor memory chip suchas a flash memory chip attached against removal, and a hologram memory.

Further, the digital still camera 1 may be configured such that adisplay section 33 executes image display making use of picked up imagedata obtained by the signal processing section 24 to display athrough-picture which is an image which is being currently picked up.

For example, while the signal processing section 24 fetches a picked upimage signal output from the A/D converter 23 to generate picked upimage signal corresponding to a single still picture as describedhereinabove, it successively carries out the operation to successivelygenerate picked up image data corresponding to frame images of a dynamicpicture. Then, the picked up image data generated successively in thismanner are transferred to a display driver 32 under the control of thecontrol section 27.

The display driver 32 generates a driving signal for driving the displaysection 33 based on the picked up image data input thereto from thesignal processing section 24 as described above and outputs the drivingsignal to the display section 33. Consequently, the display section 33successively displays images based on the picked up image data in a unitof a still picture.

If user see this, the image that is picked up is at the time isdisplayed on the display section 33 in a moving image. That is, athrough-picture is displayed.

Further, the digital still camera 1 can reproduce image data recorded inthe memory card 40 and causes the display section 33 to display an imageof the image data.

To this end, the control section 27 designates image data and issues aninstruction to the medium controller 26 to read out data from the memorycard 40. In accordance with the instruction, the medium controller 26accesses an address on the memory card 40 on which the designated imagedata are recorded to execute data reading and transfers the read outdata to the encoding/decoding section 25.

The encoding/decoding section 25 extracts entity data as compressedstill picture data from within the picked up image data transferredthereto from the medium controller 26, for example, under the control ofthe control section 27 and then executes a decoding processcorresponding to the compression coding for the compressed still picturedata to obtain picked up image data corresponding to one still picture.Then, the encoding/decoding section 25 transfers the picked up imagedata to the display driver 32. Consequently, an image of the picked upimage data recorded on the memory card 40 is reproduced and displayed onthe display section 33.

The display section 33 can display not only such a through-picture of areproduced image of image data but also a user interface image oroperation image.

In this instance, the control section 27 generates displaying image dataas a necessary user interface image, for example, in response to anoperation state then and outputs the generated displaying image data tothe display driver 32. Consequently, a user interface image is displayedon the display section 33.

It is to be noted that the user interface image can be displayed on adisplay screen of the display section 33 separately from a monitor imageor a reproduction image of picked up image data, for example, like aparticular menu screen image, or can be displayed in a superposed orcombined image at part of the monitor screen or the reproduction imageof picked up image data.

The control section 27 includes a CPU (Central Processing Unit) andconfigures a microcomputer together with a ROM 28, a RAM 29 and soforth.

The ROM 28 stores, for example, programs to be executed by the CPU asthe control section 27 and various kinds of setting information relatingto operation of the digital still camera 1.

The RAM 29 serves as a main storage device for the CPU.

Further, a flash memory 30 in this instance is provided as a nonvolatilestorage area to be used to store various kinds of setting informationwhose alteration or rewriting is demanded, for example, in response to auser operation or an operation history.

It is to be noted that, where a nonvolatile memory such as, for example,a flash memory is adopted as the ROM 28, a partial storage area of theROM 28 may be used in place of the flash memory 30.

In the digital still camera 1, the control section 27 carries outvarious image pickup preparation processes for automatic image pickup.

First, the control section 27 executes, or controls the signalprocessing section 24 to execute, as an image pickup object detectionprocess, a process of executing image pickup object detection from frameimages obtained by the signal processing section 24 while the imagepickup visual field is varied and then searching for an image pickupobject around the digital still camera 1.

Further, as a composition process, the control section 27 carries outoptimum composition decision of deciding a composition, which isconsidered optimum in response to a mode of the image pickup objectdetected by the image pickup object detection and composition comparisonusing the composition determined optimum by the optimum compositiondetermination as a target composition.

After such image pickup preparation processes, the control section 27carries out control and processing for executing automatic recording ofa picked up image.

Further, prior to image pickup execution, that is, prior to shutterrelease, the control section 27 carries out also control for aprediction operation of presenting to the user that still picture imagepickup will be carried out.

Such control processes are hereinafter described.

An operation section 31 includes various operation elements provided onthe digital still camera 1 and operation information signal outputtingelements for generating operation information signals responsive tooperation carried out for the operation elements and outputting theoperation information signals to the control section 27.

The operation elements include the release button 31 a and a powersupply button, a mode button, a zoom operation button, an operation dialand so forth whose illustration is omitted in FIG. 1.

Where the display section 33 is formed as a touch panel, also the touchsensor section of the display section 33 is included in the operationsection 31.

Also a reception section for receiving a command signal from a remotecontroller may be included in the operation section 31.

The control section 27 executes predetermined processing in response toan operation information signal input thereto from the operation section31. Consequently, operation of the digital still camera 1 in accordancewith the user operation is executed.

It is to be noted that, while the touch sensor in the foregoingdescription is provided on the camera platform 10, as a possibleconfiguration, the touch sensor may be provided in a housing of thedigital still camera 1. Also the touch sensor in this instance isincluded in the operation section 31 shown in FIG. 8.

A camera platform responding communication section 34 executescommunication between the camera platform 10 side and the digital stillcamera 1 side in accordance with a predetermined communication method.

The camera platform responding communication section 34 has a physicallayer configuration for allowing transmission and reception of acommunication signal with a communication section on the camera platform10 side, for example, in a state wherein the digital still camera 1 isattached to the camera platform 10 and a configuration for implementinga communication process corresponding to a predetermined layer which isan upper layer with respect to the physical layer. As the physical layerconfiguration, the connector to be connected to the connector 14 in FIG.2 is included.

Further, in order to make charging from the camera platform 10 sidepossible, each of the connectors mentioned includes not only terminalsfor transferring a communication signal but also terminals fortransmission of charging power. Though not, shown, the digital stillcamera 1 includes a battery receiving section for removably receiving abattery, and a battery received in the battery receiving section ischarged based on electric power sent from the camera platform 10 side.

The digital still camera 1 sometimes includes a sound inputting section35. The sound inputting section 35 is used to detect an input of, forexample, voice of a particular word or of particular sound such as, forexample, sound by clapping of hands as a trigger input to a requestresponding image pickup mode hereinafter described.

The sound inputting section 35 includes a sound signal processingcircuit including a microphone and a microphone amplifier, a soundanalysis section for deciding particular sound, and so forth. It is tobe noted that sound analysis may otherwise be executed by the controlsection 27.

Also where an input of voice of a particular word or of particular soundis to be decided for decision of a shutter release timing, the soundinputting section 35 is provided.

Further, the digital still camera 1 sometimes includes a releaseprediction execution section 36. The release prediction executionsection 36 executes a release prediction operation hereinafterdescribed.

The release prediction execution section 36 may be any apparatus sectionwhich can present to a user by indication or sound that still pictureimage pickup will be carried out.

For example, the release prediction execution section 36 may beconfigured as a light emission operation section including a lightemitting element such as an LED and a light emission driving circuit forthe light emitting element in order to carry out prediction, forexample, with a predetermined light emission pattern.

Or, the release prediction execution section 36 may be a display sectionwhich is provided as a liquid crystal display section or the likeprovided on the front face side of the housing of the digital stillcamera 1 and carries out previous prediction through particularcharacter display, color display, pattern display or the like.

Or else, the release prediction execution section 36 may be formed as asound outputting section which carries out prediction through electronicsound, beep sound, message voice or the like and includes a sound signalgeneration section, an amplifier, a speaker and so forth.

Or else, the release prediction execution section 36 may be formed as asuitable combination of the sections described above.

1-3. Camera Platform

FIG. 9 shows an example of an internal configuration of the cameraplatform 10.

Referring to FIG. 9, the camera platform 10 includes a power supplyterminal section t-Vin and a video terminal section t-Video as describedhereinabove with reference to FIG. 6.

Electric power input through the power supply terminal section t-Vin issupplied as operation power necessary for the components of the cameraplatform 10 through a power supply circuit 61. The power supply circuit61 further generates charging electric power for the digital stillcamera 1 and supplies the charging electric power to the digital stillcamera 1 side through a communication section 52 and associatedconnectors.

Meanwhile, to the video terminal section t-Video, an image signaltransmitted from the digital still camera 1 side is supplied through thecommunication section 52 and a control section 51.

It is to be noted that, while it is described above that the operationelectric power for the components of the camera platform 10 is suppliedonly through the power supply terminal section t-Vin, actually thecamera platform 10 has a receiving section for a cell such thatoperation electric power for the components can be supplied from a cellreceived in the receiving section.

The camera platform 10 further includes a connection detection section59 for detecting whether or not a cable is connected to each of thepower supply terminal section t-Vin and the video terminal sectiont-Video. As a particular configuration of the detection mechanism forcable connection, for example, a switch may be used for on/off switchingby connection/disconnection of a cable. However, the connectiondetection section 59 may have any configuration only if it outputs adetection signal for identification of connection/disconnection of acable, and the particular configuration of the same is not limitedparticularly.

A detection signal of the connection detection section 59 is supplied tothe control section 51. More particularly, a detection signal regardingthe power supply terminal section t-Vin and a detection signal regardingthe video terminal section t-Video are supplied to the control section51.

Further, as described hereinabove, the camera platform 10 includes apan-tilt mechanism. More particularly, as the pan-tilt mechanism, thecamera platform 10 includes a pan mechanism section 53, a pan motor 54,a tilt mechanism section 56 and a tilt motor 57 as shown in FIG. 9.

The pan mechanism section 53 is configured including a mechanism forproviding a movement in the pan direction illustrated in FIG. 4, thatis, in the horizontal direction or leftward or rightward direction tothe digital still camera 1 attached to the camera platform 10. Themovement of the mechanism is obtained by rotation of the pan motor 54 inthe forward direction or the reverse direction.

Similarly, the tilt mechanism section 56 is configured including amechanism for providing a movement in the tilt direction illustrated inFIGS. 5A and 5B, that is, in the vertical direction or upward ordownward direction to the digital still camera 1 attached to the cameraplatform 10. The movement of the mechanism is obtained by rotation ofthe tilt motor 57 in the forward direction or the reverse direction.

The control section 51 is configured, for example, as a microcomputerformed from a combination of a CPU, a ROM, a RAM and so forth andcontrols the movement of the pan mechanism section 53 and the tiltmechanism section 56.

For example, when the control section 51 is to control the movement ofthe pan mechanism section 53, it outputs a signal indicative of adirection of the movement and a moving speed to the pan driving section55. The pan driving section 55 generates a motor driving signalcorresponding to the signal input thereto and outputs the motor drivingsignal to the pan motor 54. If the pan motor 54 is, for example, astepping motor, then the motor driving signal is a pulse signal for PWMcontrol.

In response to the motor driving signal, the pan motor 54 rotates, forexample, at a demanded speed in a demanded direction. As a result, alsothe pan mechanism section 53 is driven to move at a corresponding speedin a corresponding direction.

Similarly, when the control section 51 is to control the movement of thetilt mechanism section 56, it outputs a signal indicative of a movingdirection and a moving speed necessary for the tilt mechanism section 56to a tilt driving section 58. The tilt driving section 58 generates andoutputs a motor driving signal corresponding to the signal input theretoto the tilt motor 57. In response to the motor driving signal, the tiltmotor 57 rotates, for example, at a demanded speed in a demandeddirection, and consequently, also the tilt mechanism section 56 isdriven to move at a corresponding speed in a corresponding speed.

The pan mechanism section 53 includes a rotary encoder or rotationdetector 53 a. The rotary encoder 53 a outputs, in response to arotational movement of the pan mechanism section 53, a detection signalrepresentative of an angle of the rotation to the control section 51.Meanwhile, the tilt mechanism section 56 includes a rotary encoder 56 a.Also the rotary encoder 56 a outputs, in response to rotational movementof the tilt mechanism section 56, a detection signal representative ofan angle of the rotation to the control section 51.

Consequently, the control section 51 can acquire or monitor informationof the rotational angular amounts of the pan mechanism section 53 andthe tilt mechanism section 56 being driven on the real time basis.

The communication section 52 executes communication with the cameraplatform responding communication section 34 in the digital still camera1 attached to the camera platform 10 in accordance with a predeterminedcommunication method.

The communication section 52 has a physical layer configuration forallowing transmission and reception of a communication signal with anopposite side communication section by wireless or wired communicationand a configuration for implementing a communication processcorresponding to a predetermined layer which is an upper layer withrespect to the physical layer similarly to the camera platformresponding communication section 34. As the physical layerconfiguration, the connector 14 of the camera pedestal portion 12 inFIG. 2 is included.

An operation section 60 includes an operation element as the menu button60 a shown in FIG. 4 or 6, and an operation information signaloutputting block for generating an operation information signalcorresponding to an operation carried out for the operation element andoutputting the operation information signal to the control section 51.The control section 51 executes a predetermined process in response tothe operation information signal input thereto from the operationsection 60.

It is to be noted that, while it is described with reference to FIG. 7that the camera platform 10 may include a touch sensor, also the touchsensor is included in the operation section 60. In this instance, adetection signal of a touch operation by the touch sensor is supplied tothe control section 51.

Further, where a remote controller is prepared for the camera platform10, also a reception section for a command signal from the remotecontroller is included in the operation section 60.

The camera platform 10 may include a sound inputting section 62. Thesound inputting section 62 is provided in order to detect an input of,for example, sound of a particular word or particular sound such as, forexample, sound by clapping of hands as a trigger input to a requestresponding image pickup mode hereinafter described.

The sound inputting section 62 includes a sound signal processingcircuit including a microphone and a microphone amplifier, a soundanalysis section for deciding particular sound and so forth. It is to benoted that the sound analysis may otherwise be executed by the controlsection 51.

Further, the sound inputting section 62 may be provided on the cameraplatform 10 side so as to be ready for a case in which an input of voiceof a particular word or particular sound is decided as a decision of arelease timing for the digital still camera 1.

Further, the camera platform 10 may include an image pickup section 63.The image pickup section 63 is provided in order to detect a particularstate of an image pickup object such as, for example, a particular pauseor the eyes of a user on the image pickup object side as a trigger inputto a request responding image pickup mode.

The image pickup section 63 includes an optical system section, an imagesensor, an A/D converter, a signal processing section, an image analysissection and so forth. It is to be noted that the image analysis mayotherwise be executed by the control section 51.

Further, where a particular image pickup object state is decided for adecision of a release timing in the digital still camera 1, the imagepickup section 63 may be provided on the camera platform 10 side.

Further, the camera platform 10 may include a release predictionexecution section 64. The release prediction execution section 64executes a release prediction operation hereinafter described.

The release prediction execution section 64 may be any apparatus sectiononly if it can present to the user by an indication or sound that stillpicture image pickup will be carried out.

For example, the release prediction execution section 64 may beconfigured as a light emission operation section including a lightemitting element such as an LED and a light emission driving circuit forthe light emitting element in order to carry out prediction, forexample, with a predetermined light emission pattern or in apredetermined light emission period.

Or, the release prediction execution section 64 may be a display sectionwhich is provided as a liquid crystal display section or the likeprovided on the front face side of the housing of the digital stillcamera 1 and carries out prediction through particular characterdisplay, color display, pattern display or the like.

Or else, the release prediction execution section 64 may be formed as asound outputting section which carries out prediction through electronicsound, beep sound, message voice or the like and includes a sound signalgeneration section, an amplifier, a speaker and so forth.

Or else, the release prediction execution section 64 may be formed as asuitable combination of the sections described.

It is to be noted that the release prediction operation may bepredetermined operation of a combination of pan and tilt movements. Inthis instance, the pan mechanism section 53 and the tilt mechanismsection 56 carry out actual operation as the release predictionexecution section 64.

2. Example of the Functional Configuration

Now, an example of a functional configuration implemented by hardwareand software (program) regarding the digital still camera 1 and thecamera platform 10 which configure the image pickup system is described.

The present functional configuration example is configured so as toimplement an image pickup control apparatus for carrying out imagepickup operation control of the image pickup system. The functionalconfiguration example includes hardware configurations principallyincluding the control section 27 of the digital still camera 1, thecontrol section 51 of the camera platform 10 and so forth, andcontrolling processing functions formed by association of softwaremodules started by the hardware configurations. In FIG. 10, controlfunctions necessary for processing in an automatic image pickup mode anda request responding image pickup mode hereinafter described areindividually shown as blocks.

It is to be noted that, while various functional configuration examplesmay be possible, FIG. 10 shows one of such functional configurationexamples and some other examples are shown in FIG. 31 and so forth.

Referring to FIG. 10, the digital still camera 1, particularly thecontrol section 27, includes an picked up image recording controlsection 81, an image pickup preparation processing section 82, an imagepickup visual field variation control section 83, a release predictionoperation control section 84, a communication processing section 85, amode sequence control section 86 and a trigger acceptance section 89.

Meanwhile, the camera platform 10, particularly the control section 51,includes, for example, a communication processing section 71, a pan-tiltcontrol section 72 and a trigger detection section 73.

First, on the digital still camera 1 side, the picked up image recordingcontrol section 81 acquires an image obtained by image pickup as data ofan image signal, that is, as picked up image data, and executes acontrol process for storing the picked up image data into a recordingmedium. The picked up image recording control section 81 carries outcontrol also for reproduction or displaying operation of the recordedstill picture data, for displaying operation of a through-picture uponimage pickup and so forth.

The picked up image recording control section 81 carries out control ofthe optical system section 21, image sensor 22, A/D converter 23, signalprocessing section 24, encoding/decoding section 25, medium controller26, display driver 32 and so forth of FIG. 8. In other words, the pickedup image recording control section 81 controls basic operation of thedigital still camera 1 by issuing instructions for lens driving controlof the optical system section 21, image pickup operation of the imagesensor 22, image signal processing, recording and reproductionprocessing and so forth so that still picture image pickup and so forthare executed.

The image pickup preparation processing section 82 carries out an imagepickup preparation process in the automatic image pickup mode and therequest responding image pickup mode, that is, when image pickup of astill picture which does not rely upon a release operation of a user isto be executed.

The image pickup preparation process includes an image pickup objectdetection process. In the image pickup object detection process, whilethe camera platform 10 executes pan and tilt movements, frame imagesobtained by the signal processing section 24 are successively confirmedand processed so that an image pickup object such as, for example, theface of a person may be included in the image pickup visual field. Tothis end, the image pickup preparation processing section 82 carries outsuch processes as decision of necessary pan and tilt movements of thecamera platform 10, person detection by image analysis of frame imagedata, face detection and so forth.

The image pickup preparation process further includes a compositionprocess. In the composition process, it is decided whether or not thearrangement of an image pickup object image in the image pickup visualfield is in an optimum state (composition decision), and then thecomposition is adjusted (composition adjustment). For this adjustment ofthe composition, the image pickup preparation processing section 82carries out decision of necessary panning and tilt movements of thecamera platform 10, decision of zoom lens driving of the optical systemsection 21 and so forth.

It is to be noted that the processing function of carrying out imageanalysis for the image pickup object detection process and thecomposition process may be executed not by the control section 27 but bya DSP (Digital Signal Processor) serving as the signal processingsection 24. Accordingly, the processing section as the image pickuppreparation processing section 82 can be implemented by a program andinstructions to be provided to one or both of the control section 27 andthe DSP as the signal processing section 24.

The image pickup visual field variation control section 83 controlsoperation of actually varying the image pickup visual field. Thevariation of the image pickup visual field is carried out by pan-tiltmovements of the camera platform 10 or by zoom operation of the opticalsystem section 21. Accordingly, the image pickup visual field variationcontrol section 83 is a functional block of carrying out pan-tiltcontrol and/or zoom control.

Where a cameraman uses the digital still camera 1 to manually carry outimage pickup, the image pickup visual field variation control section 83controls zoom lens driving, for example, in response to a zoom operationof the cameraman.

On the other hand, in the automatic image pickup mode or the requestresponding image pickup mode hereinafter described, the image pickupvisual field variation control section 83 carries out zoom drivingcontrol, pan driving control and tilt driving control in response to adecision or instruction of the image pickup preparation processingsection 82. For the pan driving control and the tilt driving control,the image pickup visual field variation control section 83 transmits apan-tilt control signal to the camera platform 10 side through thecommunication processing section 85.

Particularly upon execution of composition adjustment or the like, theimage pickup visual field variation control section 83 outputs, inresponse to pan-tilt movement amounts decided by the image pickuppreparation processing section 82, a pan-tilt control signal instructiveof the movement amounts to the camera platform 10.

Further, the image pickup visual field variation control section 83drives and controls the zoom movement of the optical system section 21in response to a zoom magnification decided by the image pickuppreparation processing section 82.

The release prediction operation control section 84 controls executionaction of release prediction hereinafter described.

As described hereinabove, for example, with reference to FIGS. 8 and 9,the release prediction execution section 36 or 64 is sometimes providedin one or both of the digital still camera 1 and the camera platform 10.The release prediction operation control section 84 carries out controlof causing the release prediction execution section 36 or 64 to carryout sound outputting, light emission outputting and displayingoutputting.

Where the release prediction action is executed by a behavior of thedigital still camera 1, a pan-tilt control signal is supplied to thecamera platform 10 side in order to implement the behavior.

The communication processing section 85 executes communication inaccordance with a predetermined communication protocol with thecommunication processing section 71 provided on the camera platform 10side.

The pan-tilt control signal generated by the image pickup visual fieldvariation control section 83 is transmitted to the communicationprocessing section 71 of the camera platform 10 by communication of thecommunication processing section 85.

The mode sequence control section 86 controls, where automatic stillpicture image pickup which does not originate from a release operationof the user is carried out in the automatic image pickup mode and therequest responding image pickup mode, the sequence of the mode actions.

In particular, in each of the automatic image pickup mode and therequest responding image pickup mode, control processes by the picked upimage recording control section 81, image pickup preparation processingsection 82, image pickup visual field variation control section 83 andrelease prediction operation control section 84 are executed suitably ina predetermined procedure to implement the still picture image pickupaction in the modes.

The mode sequence control section 86 includes a function as a “requestresponding image pickup control section.”

The trigger acceptance section 89 recognizes a trigger input detected,for example, by the trigger detection section 73 on the camera platform10 side through communication by the communication processing sections71 and 85 and accepts the trigger input as a changeover input from theautomatic image pickup mode to the request responding image pickup mode.The trigger acceptance section 89 notifies the mode sequence controlsection 86 of the trigger acceptance. It is to be noted that thefunction of the trigger acceptance section 89 may be regarded as afunction of the mode sequence control section 86.

Further, on the camera platform 10 side, the communication processingsection 71 executes communication with the communication processingsection 85 on the digital still camera 1 side.

Where the pan-tilt control signal described hereinabove is received, thecommunication processing section 71 outputs the pan-tilt control signalto the pan-tilt control section 72.

The pan-tilt control section 72 executes processing regarding pan-tiltcontrol from among the control processes executed by the control section51 on the camera platform 10 side, for example, shown in FIG. 9.

The pan-tilt control section 72 controls the pan driving section 55 andthe tilt driving section 58 shown in FIG. 9 in accordance with thepan-tile control signal input thereto. Consequently, pan and tiltmovements, for example, for an image pickup object detection process orpanning, tilting and so forth for obtaining an optimum horizontal viewangle and an optimum vertical view angle by the composition process arecarried out.

The trigger detection section 73 detects a trigger input for changingover from the automatic image pickup mode to the request respondingimage pickup mode.

As an example, if the trigger input is a touching operation with thetouch region 60 b provided on the camera platform 10 as shown in FIG. 7,then the trigger detection section 73 detects an input to the touchsensor.

Further, where a trigger input from the sound inputting section 62and/or the image pickup section 63 of FIG. 9 is detected in addition toa touch input, the trigger detection section 73 carries out a process ofsupervising and detecting such trigger inputs.

If a trigger input is detected, then the trigger detection section 73transmits a trigger detection signal from the communication processingsection 71 to the mode sequence control section 86 of the digital stillcamera 1.

3. Automatic Image Pickup Process

Before an operation sequence is described, an image pickup process inthe automatic image pickup mode is described with reference to FIG. 11A.

In the automatic image pickup mode, the image pickup system carries outautomatic composition adjustment operation in which a compositiondecided to be optimum in response to a mode of an image pickup objectdetected by image pickup object detection by the operations of imagepickup object detection or search, optimum composition decision andcomposition adjustment is set as a target composition. Then, releaseprocessing is automatically carried out at the predetermined condition.This makes operation of cameraman unnecessary, and appropriate stillimage pickup is carried out.

FIG. 11A illustrates a procedure of predetermined processes carried outby the functional blocks in accordance with instructions of the modesequence control section 86 of FIG. 10 as automatic image pickup modeoperation.

After image pickup operation in the automatic image pickup mode isstarted, fetching of picked up image data is started at step F1 of FIG.11A.

In particular, the picked up image recording control section 81 controlsthe image sensor 22 and the signal processing section 24 to startfetching of picked up image data for each frame.

An image pickup object detection process is carried out at step F2, anda composition process is carried out at step F3.

The image pickup object detection process and the composition processwhich includes optimum composition decision and composition adjustmentare carried out by functions of the image pickup preparation processingsection 82, particularly by processing of the control section 27 and/orthe signal processing section 24.

After the fetching of picked up image data is started at step F1, thesignal processing section 24 successively acquires frame image datacorresponding to one still picture as picked up image data by the imagesensor 22.

The image pickup preparation processing section 82 carries out, as theimage pickup object detection process, processing of detecting an imageportion corresponding to the face of a person from within the frameimage data of each frame.

It is to be noted that the image pickup object detection process may beexecuted for all frames or frames at a predetermined number of frameintervals.

In the image pickup object detection process in the present example, forexample, a face detection technique is utilized to set, for each imagepickup object detected from within an image, a face range correspondingto the region of the image portion of the face of the image pickupobject. Then, from information of the number, size, position and soforth of such face regions, information of the number of image pickupobjects in the frame range, the size of each image pickup object, andthe position of each image pickup object in the respective picture rangeis obtained.

It is to be noted that, although several techniques for detection of theface are known, which one of the detection techniques should be adoptedis not limited particularly, but a suitable technique may be adoptedtaking the detection accuracy, the degree of difficulty in design and soforth into consideration.

As the image pickup object detection process at step F2, search forimage pickup objects existing around the digital still camera 1 iscarried out first.

In particular, the search for image pickup objects is carried out suchthat, while the control section 27 of the digital still camera 1,particularly the image pickup preparation processing section 82 and theimage pickup visual field variation control section 83, carry outpan-tilt control for the camera platform 10 and zoom control for theoptical system section 21 to vary the image pickup visual field, imagepickup object detection by image analysis is executed, for example, bythe signal processing section 24 or the control section 27.

Such image pickup object search is executed until after an image pickupobject is detected in a frame image as picked up image data. Then, whenthe situation, in which the image pickup object (face) is present in theframe image, that is, in the image pickup visual field at the point oftime, is obtained, image pickup object search is ended.

After the image pickup object detection process comes to an end, thecontrol section 27, particularly the image pickup preparation processingsection 82, carries out a composition process at step F3.

In particular, in the composition process, it is decided whether or notthe composition at the point of time is in an optimum state. In thisinstance, decision of a picture structure, in this instance, decision ofthe number of image pickup objects in the picture range, the size of theimage pickup objects and the position of the image pickup objects, basedon a result of the image pickup object detection is carried out first.Then, based on the information of the picture structure decided by thepicture structure decision, a composition estimated to be optimum isdecided in accordance with a predetermined algorithm.

Here, the compositions in this instance are determined by the individualimage pickup visual fields in pan, tilt and zoom operations.Accordingly, depending upon a decision process regarding whether or notthe composition is optimum, information of control amounts for pan, tiltand zoom operations for obtaining an optimum image pickup visual fieldin response to the image pickup detection result, that is, to the modeof an image pickup object in the picture range, is obtained as adecision result of the decision process.

Then, if the composition is not in an optimum state, then pan-tiltcontrol and zoom control are carried out in order to obtain an optimumcomposition state.

In particular, the control section 27, particularly the image pickuppreparation processing section 82 and the image pickup visual fieldvariation control section 83, issue an instruction for variation of thepan-tilt control amounts determined by the optimum composition decisionprocess to the control section 51 of the camera platform 10 side ascomposition adjustment control.

In response to the instruction, the control section 51 of the cameraplatform 10 calculates movement amounts regarding the pan mechanismsection 53 and the tilt mechanism section 56 in accordance with theinstruction control amounts and supplies control signals to the pandriving section 55 and the tilt driving section 58 so that pan drivingand tilt driving of the calculated movement amounts may be carried out.

Further, the control section 27, particularly the image pickuppreparation processing section 82 and the image pickup visual fieldvariation control section 83, issue an instruction of information of theview angle regarding zoom operation calculated by the optimumcomposition decision process to the optical system section 21 so thatzoom operation by the optical system section 21 is executed to obtainthe instruction view angle.

It is to be noted that, if it is decided by the composition process thatthe composition is not an optimum composition and pan-tilt and zoomcontrol is carried out as the composition adjustment, then theprocessing returns from step F3 to step F2 so that the image pickupdetection process is carried out again. This is because an image pickupobject may move out of the image pickup visual field by the pan, tilt orzoom operation or by a motion of the person.

If an optimum composition is obtained, then the control section 27,particularly the mode sequence control section 86, carries out a releasetiming decision process at step F4.

For example, a release operation may be carried out setting it as acondition that an image pickup object enters a predetermined state suchas a smiling state.

It is to be noted that, although the release timing may not be decidedOK by the release timing decision process at step F4, in this instance,the processing is carried out again beginning with the image pickupobject detection at step F1. This is because an image pickup object maymove out of the image pickup visual field or the composition may loseits shape as a result a motion of an image pickup object person or thelike.

If it is decided by the release timing decision process that the releasecondition is satisfied, then automatic recording of the picked up imagedata is carried out as a release process at step F5. In particular, thecontrol section 27, particularly the picked up image recording controlsection 81, carries out control of the encoding/decoding section 25 andthe medium controller 26 to execute recording of the picked up imagedata or frame image obtained at the point of time into the memory card40.

In the image pickup system described above, still picture image pickupin the automatic image pickup mode is implemented in such a manner asdescribed above with reference to FIG. 11A based on the control andprocessing by the control section 27.

It is to be noted that processing illustrated in FIG. 11B is hereinafterdescribed as a fourth embodiment of the present invention.

4. Image Pickup Operation of the First Embodiment

Operation of a first embodiment of the present invention implementedbased on the configuration of the digital still camera 1 and the cameraplatform 10 described hereinabove with reference to FIGS. 8 and 9 andthe functional configurations described hereinabove with reference toFIG. 10 is described with reference to FIG. 12.

It is to be noted that, where the functional configuration of FIG. 10 ispresupposed, the processing of FIG. 12 can be considered as processingof the control section 27 of the digital still camera 1.

If an automatic image pickup instruction is generated by an operation bythe user such as, for example, a power supply turn-on operation or anoperation for an operation menu screen image on the display section 33,then operation of the present system in the automatic image pickup modeis started.

In response to such a starting operation of the automatic image pickupmode by the user, the control section 27, particularly the mode sequencecontrol section 86, advances its processing from step F101 to step F102in FIG. 12 to start processing of the automatic image pickup mode.

The control section 27, particularly the mode sequence control section86, carries out the processing described hereinabove with reference toFIG. 11A so that automatic still picture image pickup is executed.

As a behavior of the image pickup system which actually looks to theuser, the digital still camera 1 is driven by the camera platform 10 toautomatically carry out pan-tilt operations and a zoom operation tosearch for an image pickup object, and still picture image pickup iscarried out at an arbitrary point of time. In other words, it looksthat, while no cameraman exists, the image pickup system uses its owninitiative to determine an image pickup object and carry out stillpicture image pickup.

In this instance, since no cameraman exists, still picture image pickupin a natural atmosphere in which the user is not conscious of imagepickup is likely to be carried out.

Here, within a period within which the control section 27, particularlythe mode sequence control section 86, continues to execute the processin the automatic image pickup mode at step F102, it supervises thetrigger input to the request responding image pickup mode at step F103.

Though not shown in FIG. 11A, whether or not there is a trigger input isconfirmed within the period from stop F2 to step F4 of FIG. 11A.

In the present first embodiment, it is assumed that the touch region 60b is formed on the camera platform 10 as shown in FIG. 7A and a touchingoperation of the user with the touch region 60 b is used as a triggerinput to the request responding image pickup mode.

Further, if a trigger input is not detected particularly, then the stillpicture image pickup in the automatic image pickup mode at step F102 iscontinued until it is decided at step F104 that the automatic imagepickup is to be ended. Within the period from step F2 to step F4 of FIG.11A, also an ending operation of the user is supervised in addition tothe confirmation of whether or not a trigger input exists.

If the user carries out a predetermined operation to input an automaticimage pickup ending instruction, then the control section 27,particularly the mode sequence control section 86, advances theprocessing in FIG. 12 from step F104 to step F105, at which apredetermined ending process is carried out to end the series ofoperations.

If the user carries out a touching operation with the touch region 60 bof the camera platform 10 in the automatic image pickup mode, then thecontrol section 51, particularly the trigger detection section 73, inthe camera platform 10 detects the touching operation and transmits atrigger detection signal to the control section 27, particularly to thetrigger acceptance section 89 and the mode sequence control section 86.

Consequently, when the control section 27, particularly the modesequence control section 86, recognizes that a trigger input is receivedand accepts the trigger input, it advances its processing of FIG. 12from step F103 to step F106, at which it carries out operation controlin the request responding image pickup mode.

At steps F106 to F109, processes in the request responding image pickupmode are carried out.

In particular, at step F106, the control section 27, particularly theimage pickup preparation processing section 82 and the image pickupvisual field variation control section 83, carry out the image pickupobject detection process.

Then at step F107, the control section 27, particularly the image pickuppreparation processing section 82 and the image pickup visual fieldvariation control section 83, carry out the composition process.

The image pickup object detection process and the composition processdetermine an image pickup visual field in accordance with an imagepickup request.

As an example, the image pickup object detection process at step F106and the composition process at step F107 may be carried out inaccordance with an algorism same as that used in the image pickup objectdetection process at step F2 and the composition process at step F3 ofFIG. 11A in the automatic image pickup mode.

Here, the request responding image pickup mode is a mode in which stillpicture image pickup is carried out in accordance with a request of auser. Accordingly, to this end, it is necessary to grasp a user whoissues an image pickup request, that is, a touching operation, as animage pickup object. This is considered to be a process of determiningthe image pickup visual field in accordance with an image pickuprequest.

Where the touch region 60 b is set to the front face side of the mainbody portion 11 of the camera platform 10 as shown in FIG. 7A, it isconsidered that a user from which an image pickup request is issued by atouching operation is on the front face side of the image pickup system.

Accordingly, if the algorithm for image pickup object detection definesthat the initial position is given by a pan state in the front facedirection, that is, at the pan reference position in FIG. 4, and by thetilt reference position of FIGS. 5A and 5B, then if the image pickupobject detection and composition processes are carried out in thisstate, then it is considered that, in almost all cases, the user can becaught in the image pickup visual field. From this, the image pickupobject detection process at step F106 and the composition process atstep F107 should be started in the initial state in accordance with analgorithm similar to that used in the automatic image pickup mode.

However, in order to carry out effective still picture image pickup inthe request responding image pickup mode, it is sometimes appropriate tocarry out the image pickup object detection and composition processes inaccordance with an algorithm different from that used in the automaticimage pickup mode. Various such examples are hereinafter described asmodifications.

If an optimum composition is obtained by the processes at steps F106 andF107, then the control section 27, particularly the release predictionoperation control section 84, carries out a release prediction processat step F108.

Where the release prediction execution section 36 is provided on thedigital still camera 1 side as described hereinabove with reference toFIG. 8, the control section 27, particularly the release predictionoperation control section 84, controls the release prediction executionsection 36 to execute predetermined operation.

For example, the release prediction execution section 36 is controlledto execute LED flickering indication, cause the LED to emit light in apredetermined flickering period or in a predetermined flickeringpattern, generate electronic sound or generate message sound such as“say ‘cheese’.”

Further, where a release prediction is to be represented by a behaviorby pan-tilt movements such as, for example, such a behavior that thedigital still camera 1 trembles or nods, the release predictionoperation control section 84 instructs the image pickup visual fieldvariation control section 83 to transmit a pan-tilt control signal forimplementing such a behavior as described above to the camera platform10 side.

Naturally, such operations as described above may be suitably combinedto carry out a release prediction.

Based on the release prediction, the user can take a pose or make a lookbefore the predicted release timing.

Then, after the release prediction, the control section 27, particularlythe picked up image recording control section 81, carries out a releaseprocess and records still picture data into the memory card 40 at stepF109.

Here, it is a possible idea to cause the control section 27,particularly the picked up image recording control section 81, to carryout, when a predetermined still picture image pickup condition issatisfied after execution of a release prediction operation or afterstarting of such execution, a release process to carry out a stillpicture image pickup operation.

For example, it is supposed that, when a particular sound input isreceived, when a particular image pickup object state is decided from apicked up image, when a predetermined period of time elapses afterexecution of a release prediction operation or after starting of suchexecution, or in some other case, it is decided that the still pictureimage pickup condition is satisfied.

As such a particular sound input as mentioned above, for example, aparticular word uttered from the user, sound by clapping of hands, soundof a whistle or the like may be detected.

As a particular image pickup object state, a particular expression suchas a smile of an image pickup object caught by the composition process,a particular gesture such as, for example, waving of a hand toward theimage pickup system, raising of a hand, clapping of hands or a behaviorsuch as making of a V-sign or winking or steady gazing at the imagepickup system may be detected.

The lapse of a predetermined period of time may be, for example, lapseof a predetermined period of time such as, for example, several secondsafter execution of the release prediction operation or from a point oftime of starting of the execution.

The control section 27, particularly the mode sequence control section86, may carry out a necessary detection process under such still pictureimage pickup conditions as described above and, when the still pictureimage pickup conditions are satisfied, carry out the release process,that is, recording of a still picture, under the control of the pickedup image recording control section 81.

The control section 27, particularly the mode sequence control section86, advances, after the still picture image pickup, the processing tostep F102, at which it ends the request responding image pickup mode andthen carries out processes as the automatic image pickup mode again.

Where the process of FIG. 12 is executed, when still picture imagepickup is carried out in the automatic image pickup mode, the user maycarry out a touching operation when it is intended to pick up an imageof the user itself. Consequently, the operation in the requestresponding image pickup mode is carried out, and still picture imagepickup is carried out in accordance with a request of the user. Sincealso a release prediction is carried out at this time, the user can pickup an image of the user itself in an expression, eyes, form and so forthin which the user wants to be imaged.

In short, with the present embodiment, by image pickup in the automaticimage pickup mode, an image can be picked up in a natural expression,form, scene and so forth, and by image pickup in the request respondingimage pickup mode, an image complying with a desire of the user can bepicked up. In other words, a still picture image intended by the user ora commemorative picture can be picked up.

Consequently, as automatic image pickup which does not demand acameraman, a variety of still picture image pickup equivalent to thatwhere image pickup is carried out by a cameraman can be carried out.

5. Modifications to the First Embodiment

5-1. Trigger to the Request Responding Image Pickup Mode

In the following, several modifications to the first embodimentdescribed are described. First, a trigger input to the requestresponding image pickup mode is described.

In the description given hereinabove, an example wherein a touchingoperation of the user with the camera platform 10 is recognized as atrigger operation is described. As regards the touching operation, atouch region may be provided on the housing of the digital still camera1 such that, when the user touches the touch region of the digital stillcamera 1, the image pickup system recognizes this as a triggeroperation. A functional configuration in this instance is hereinafterdescribed with reference to FIG. 31.

Meanwhile, as regards an operation of the user for a trigger input, anoperation button may be provided on the camera platform 10 or thedigital still camera 1 such that an operation of the operation button isused as a trigger input.

Further, a configuration may be used wherein the user carries out atrigger operation through an operation of a remote controller of thewireless type which utilizes an infrared ray or an electromagnetic waveor of the wired type.

Meanwhile, the trigger detection section 73 may detect a particularsound input as a trigger input. For example, the sound inputting section62 may be provided in the camera platform 10 as described hereinabovewith reference to FIG. 9 such that a particular sound input isrecognized by the control section 51, particularly by the triggerdetection section 73.

The particular sound input may be a certain word or words such as, forexample, words “take a photo of me!” uttered by the user, sound byclapping of hands or the like.

The sound inputting section 35 or the trigger detection section 73carries out an analysis process of the input sound signal to decidewhether or not the particular sound input is received. Then, if theparticular sound input is found, then the sound inputting section 35 orthe trigger detection section 73 recognizes that a trigger input isreceived.

For example, in response to detection of such various triggers asdescribed above, the control section 27 on the digital still camera 1side can control the trigger acceptance section 89 to accept the triggerto the request responding image pickup mode.

It is to be noted that, also where the control section 27 on the digitalstill camera 1 side includes a function as a trigger detection sectionin addition to the trigger acceptance section 89, since the soundinputting section 35 described hereinabove with reference to FIG. 8 isprovided, detection of a trigger input by such a particular sound inputas described above and acceptance of the trigger input as a trigger tothe request responding image pickup mode can be carried out.

The trigger detection section 73 may possibly detect that a triggerinput is received if a particular image pickup object state is decidedfrom within a picked up image.

For example, the image pickup section 63 is provided in the cameraplatform 10 as described hereinabove with reference to FIG. 9, and thecontrol section 51, particularly the trigger detection section 73,recognizes an image pickup object state detected from within a picked upimage as a trigger input.

As the particular image pickup object state, a particular gesture suchas, for example, waving of a hand toward the image pickup system,raising of a hand, clapping of hands or a behavior such as making of aV-sign or winking toward the image pickup system may be detected. Or theuser may possibly gaze at the image pickup system.

The image pickup section 63 or the trigger detection section 73 carriesout an image analysis process of a picked up image to decide aparticular gesture of the user or the eyes of the user. Then, if aparticular image pickup object state is detected, then the image pickupsection 63 or the trigger detection section 73 recognizes that a triggerinput is received.

It is to be noted that, where the control section 27 on the digitalstill camera 1 side includes a function as the trigger detection sectionin response to the trigger acceptance section 89, since a behavior, theeyes or the like as such a particular image pickup object state asdescribed above can be recognized in the procedure of the imageanalysis, that is, the image pickup object detection process, by thesignal processing section 24, detection of a trigger input based on theparticular image pickup object state and acceptance of the trigger inputas a trigger to the request responding image pickup mode can be carriedout.

5-2. Pan-Tilt to the Requested Direction

Now, an example of the image pickup preparation process where theautomatic image pickup mode is established is described.

FIG. 13 illustrates an example of processing of the image pickuppreparation process. The processing of FIG. 13 includes steps F101 toF109 similar to those of the processing of FIG. 12 describedhereinabove, and overlapping description of the processes at the commonsteps is omitted herein to avoid redundancy.

Referring to FIG. 13, in the processing illustrated, when a trigger tothe request responding image pickup mode is detected at step F103,processes at steps F120 and F121 are executed prior to starting of theimage pickup object detection process at step F106.

In particular, at step F120, the control section 27 decides a requesteddirection. The requested direction is a direction to which a user whocarries out trigger inputting exists with reference to the position ofthe image pickup system, that is, a direction of the trigger input.

At step F121, the control section 27 carries out pan-tilt control in therequested direction so that the image pickup direction of the digitalstill camera 1 may be directed to the requested direction.

A particular example is described.

For example, where a touching operation is used as a trigger input, aplurality of touch regions 60 b to 60 d are provided toward differentdirections as described hereinabove with reference to FIG. 7B.

When the control section 51, particularly the trigger detection section73, of the camera platform 10 detects a touching operation, it transmitsnot only a trigger detection signal but also information regarding whichone of the touch regions 60 b to 60 d the user touches, or informationof the trigger input direction, to the control section 27, particularlyto the trigger acceptance section 89 and the mode sequence controlsection 86, of the digital still camera 1. Consequently, the controlsection 27 carries out the requested direction decision at step F120.

If the trigger input direction is decided, then the control section 27,particularly the image pickup preparation processing section 82 and theimage pickup visual field variation control section 83, output apan-tilt control signal at step F121 so that the image pickup directionof the digital still camera 1 is directed toward the trigger inputdirection, that is, toward the requested direction. Consequently,pan-tilt operations are carried out on the camera platform 10 side andthe digital still camera 1 is directed toward the direction in which theuser exists.

In short, the image pickup preparation process is carried out such thatthe digital still camera 1 is first directed to the requested directionso as to satisfy the request of the user.

In this state, the control section 27, particularly the image pickuppreparation processing section 82 and the image pickup visual fieldvariation control section 83, carry out the image pickup objectdetection and composition processes at steps F106 and F107.

Consequently, the user which issues an image pickup request can begrasped readily and a still picture image intended by the user can beobtained readily.

Also where the trigger input is given as a sound input, such a processas described above is possible.

For example, the sound inputting section 35 or 62 includes a pluralityof microphones such that the direction from which a particular soundinput is issued is decided from a time difference between sound signalsobtained from the different microphones.

The control section 27 decides the direction in which the user whoissues the request exists from the sound input at step F120 so that thepan-tilt control in the requested direction at step F121 can be carriedout.

As an actual behavior, the image pickup system reacts with a call of theuser and turns to the user, and by the later processes at steps F106 toF109, still picture image pickup including the user is carried out.

5-3. Example Wherein Image Pickup Object Detection is not Executed inthe Request Responding Image Pickup Mode

Examples of a process wherein image pickup object detection is notcarried out in the request responding image pickup mode are illustratedin FIGS. 14 and 15. Also the process examples of FIGS. 14 and 15 includesteps F101 to F105 and F107 to F109 similar to those of FIG. 12, andoverlapping description of such common steps is omitted herein to avoidredundancy.

Referring first to FIG. 14, in the process example illustrated, when atrigger input is accepted at step F103, the control section 27 does notcarry out image pickup object detection but carries out the compositionprocess at step S107 in the state of the image pickup visual field atthe point of time.

As the composition process at step F107, for example, only zoom controlis carried out. Then, still picture image pickup is carried out by theprocesses at steps F108 and F109.

The process example described is applied assuming such a case that, whenthe digital still camera 1 is directed to a certain direction in theautomatic image pickup mode, the user carries out trigger inputtingintending to pick up an image in the certain direction.

For example, the present process example is useful in such a case that,when the user who looks at a through-picture on the display screensection 33 a on the rear face of the digital still camera 1 in theautomatic image pickup mode takes notice that an object which is notregarded as an image pickup object in the image pickup object detectionprocess enters the image pickup visual field of the user, the userimmediately comes to want to pick up an image of the object. It is to benoted that, where such an application as just described is considered,it is preferable to stop carrying out of the release prediction processat step F108.

The process example of FIG. 15 includes a combination of the pan-tiltcontrol toward the requested direction described hereinabove withreference to FIG. 13.

After a trigger input is accepted at step F103, the control section 27decides the requested direction at step F120. Then at step F121, thecontrol section 27 carries out pan-tilt control toward the requesteddirection so that the image pickup direction of the digital still camera1 may be directed to the requested direction.

Thereafter, the control section 27 carries out the composition processat step F107 and then carries out the still picture image pickup by theprocesses at steps F108 and F109.

In the case of the present process example, since the digital stillcamera 1 is directed to the requested direction, only the compositionsuch as, for example, only the zoom angle is adjusted in this state tocarry out image pickup.

5-4. Example Wherein a Composition Process is not Executed in theRequest Responding Image Pickup Mode

An example of a process wherein the composition process is not executedin the request responding image pickup mode is illustrated in FIG. 16.Also the process example of FIG. 16 includes the steps F101 to F106 andF108 to F109 similar to those of FIG. 12. However, the process exampleof FIG. 16 does not include the step F107 of FIG. 12.

Thus, in the process example of FIG. 16, when a trigger input isaccepted at step F103, the control section 27 carries out image pickupobject detection. Then, for example, if the face of the user comes intothe image pickup visual field and a result of image pickup objectdetection is determined OK, then the processing skips the compositionprocess and advances to step F108, at which the release predictionprocess is carried out. Then, the still picture image pickup process iscarried out at step F109.

This is a process in a case in which it is assumed that, in theautomatic image pickup mode, the user wants to carry out still pictureimage pickup regardless of the composition.

This process can be applied as operation when the user wants to carryout image pickup immediately particularly when it is decided that aresult of image pickup object detection is OK, that is, for example,when a person is caught into the image pickup visual field.

It is to be noted that, where such an application as just described isintended, also it is preferable not to carry out the release predictionprocess at step F108.

5-5. Picked Up Image Presentation in the Request Responding Image PickupMode

An example of a process wherein the presentation of a picked up image tothe user is carried out when still picture image pickup is carried outin the request responding image pickup mode is illustrated in FIG. 17.Also the process example of FIG. 17 includes steps F101 to F109 similarto those of FIG. 12.

Referring to FIG. 17, in the process example illustrated, after therelease process is carried out and still picture data are recorded intothe memory card 40 at step F109, the control section 27 carries out apicked up image presentation process at step F130.

In particular, at step F130, the control section 27, particularly themode sequence control section 86 and the picked up image recordingcontrol section 81, control the display section 33 to display the stillpicture data recorded by the release process.

Then, the control section 27, particularly the image pickup visual fieldvariation control section 83, transmits a pan-tilt control signal to thecamera platform 10 side. In this instance, the control section 27,particularly the image pickup visual field variation control section 83,outputs an instruction at least to the camera platform 10 to carry outdriving by 180 degrees in the pan direction. Simultaneously, the controlsection 27, particularly the image pickup visual field variation controlsection 83, may issue an instruction to carry out tilt driving by apredetermined angle in the elevation angle direction.

On the camera platform 10 side, the control section 51, particularly thepan-tilt control section 72, carries out pan-tilt driving control inresponse to the pan-tilt control signal.

Consequently, the digital still camera 1 on the camera platform 10rotates by 180 degrees.

With the present process example, immediately after still picture imagepickup of the user who has issued a request is carried out in therequest responding image pickup mode, the display section 33,particularly the display screen section 33 a, is directed to the userside. In other words, immediately after the release, the contents of thepicked up image can be presented to the user.

Consequently, the user can confirm readily at the site what stillpicture is picked up.

It is to be noted that the process at step F130 of FIG. 17 may possiblybe incorporated in the processes of FIGS. 13, 14, 15 and 16.

5-6. Tentative Composition Process

Now, an example is described wherein a tentative composition process iscarried out in the composition process at step F107 in the requestresponding image pickup mode in the process examples of FIGS. 12 to 15and 17.

First, a basic composition process executed in the automatic imagepickup mode and the request responding image pickup mode is described.

It is assumed here that, in the procedure of the image pickup objectdetection process, picked up image data of such picture contents asshown, for example, in a picture range 300 of FIG. 18. The picturecontents of the picked up image data here include one image pickupobject as a person.

The picture range 300 in this instance corresponds to an image regioncorresponding to one frame of the picked up image data. Here, it isassumed that the frame image as the picture range 300 is configured suchthat, where the horizontal pixel number, that is, the horizontal picturesize, is Cx and the vertical pixel number, that is, the vertical picturesize is Cy, it has a picture size of Cx=320 and Cy=240.

Further, a position on the picture range 300 in this instance isrepresented by coordinates (X, Y), and the position of the left uppercorner of the picture range 300 is defined as coordinates (0, 0).

Further, a vertical reference line Ld1 and a horizontal reference lineLd2 are defined virtually on the picture range 300.

The vertical reference line Ld1 is a straight line passing the middlepoint of the picture range 300 in the horizontal direction, and thehorizontal reference line Ld2 is a straight line passing the middlepoint of the picture range 300 in the vertical direction. The verticalreference line Ld1 and the horizontal reference line Ld2 are used asreference lines when the position of an image pickup object on thepicture range 300 is moved in the horizontal and vertical directions incomposition control, respectively.

Meanwhile, the coordinates (160, −120) of a cross point of the verticalreference line Ld1 and the horizontal reference line Ld2 are treated asa reference point P in the composition control.

If image pickup object detection or face detection is carried out forthe picked up image data of the picture contents illustrated in FIG. 18,then the face of the one image pickup object SBJ shown in FIG. 18 isdetected as a detection image pickup object. In particular, detection ofone face by the face detection process is regarded as detection of oneimage pickup object. Then, as a result of the detection of the imagepickup object in this manner, information of, for example, the number,direction, position and size of image pickup objects is obtained.

As regards the number of image pickup objects, for example, the numberof faces detected by the face detection may be determined. Since, in thecase of FIG. 18, the number of faces to be detected is one, a resultthat the number of image pickup objects is one is obtained.

Further, when a technique of face detection is used to carry out imagepickup object detection, as a result of the detection, a framework, thatis, a face framework FR, is set to the detected face portion of theimage pickup object.

In FIG. 18, it is shown that the face framework FR is disposedcorresponding to the face portion of an image of the image pickup objectSBJ. The face framework FR in this instance has a quadrangular shapecorresponding to the image portion of the face of the detected imagepickup object. It is to be noted that it is assumed that the faceframework FR here has a square shape.

Further, the face framework FR is set to the image portion as the faceon the picture range 300. Accordingly, also the position and size of theface framework FR on the picture range 300 are changeably set inresponse to the position, size and so forth of the face of the imagepickup object on the picture range 300 detected by the face detectionprocess at this time.

Further, as regards the position information of each image pickupobject, at least a image pickup object gravity center G(X, Y) which isthe center of gravity of the image pickup object SBJ in an image aspicked up image data is determined.

Further, as regards how to set the image pickup object gravity center G,for example, any image pickup object gravity center detection methodalready known can be adopted. As an example, a cross point of diagonallines of the quadrangle of the face framework FR detected correspondingto the image pickup object SBJ may be determined as the image pickupobject gravity center.

Meanwhile, as regards the size of the image pickup object, it is assumedthat it is represented by the size, that is, the number of pixels, ofone side of the face framework FR in the vertical or horizontaldirection.

In FIG. 18, a state in which a vertical size sizey of the face frameworkFR is detected as sizey=32 is illustrated as an example.

Further, it is assumed that, as regards the face direction for eachimage pickup object, it is detected as one of three directions includingthe leftward, forward and rightward directions.

It is assumed that it is detected from the image pickup object SBJ shownin FIG. 18 that the face direction is the forward direction.

Here, it is assumed that a result of decision that such a composition asshown in FIG. 19 should be used is obtained by the composition decisionprocess based on image pickup object detection information of the imagepickup object SBJ detected in such a manner as seen in FIG. 18.

Referring to FIG. 19, in the composition shown, the image pickup objectsize is set to the vertical size sizey=64 and the image pickup objectgravity center G is positioned at G(160, −120+Δy).

Although the composition differs, for example, also depending upon thenumber of detected image pickup objects, in order to obtain a goodcomposition, it is demanded to make the size of the image pickup objecton the picture range 300 not excessively small or great but appropriate.The image pickup object size of the vertical size sizey=64 shown in FIG.19 is decided as a value of an optimum size of the image pickup objectSBJ on the picture range 300.

Meanwhile, the disposition position of the image pickup object gravitycenter G described above is determined, for example, based on thefollowing grounds.

Where a single image pickup object SBJ is involved, the simplest andmost basic position of the image pickup object SBJ is the center of thepicture range 300. In other words, the image pickup object gravitycenter G is positioned at the reference point P.

However, such a composition that the image pickup object is positionedat the center of the screen is generally regarded as a typical one ofundesirable compositions. It is generally considered that a goodcomposition is obtained by displacing the position of an image pickupobject from the center of the screen in accordance with a certain ruleas represented, for example, by a three-division method or a golden rulemethod.

Thus, in this instance, the position of the image pickup object SBJ,that is, the image pickup object gravity center G, in the verticaldirection of the picture range 300 is displaced by a fixed distance fromthe horizontal reference line Ld2.

The amount of displacement of the image pickup object gravity center Gin the vertical direction with reference to the horizontal referenceline Ld2 in this manner is defined as vertical offset amount Δy. Thisvertical offset amount Δy and a horizontal offset amount Ax hereinafterdescribed can be represented, for example, by the quantity of pixels. Inthis instance, the Y coordinate of the image pickup object gravitycenter G in FIG. 19 is represented as (−120+Δy).

It is to be noted here that the vertical offset amount Δy is given as apositive value so that the image pickup object gravity center G ispositioned in a region of the picture range 300 on the upper side of thehorizontal reference line Ld2 as seen in FIG. 19.

Meanwhile, the position of an image pickup object in the horizontaldirection is based on the face direction detected from the image pickupobject.

As described hereinabove with reference to FIG. 18, the face directionof the image pickup object SBJ in this instance is detected as theforward direction from among the three rightward, forward and leftdirections.

Here, where the face direction of the one image pickup object SBJ isdetected as the forward direction, the image pickup object is positionedat the center in the horizontal direction. In other words, the Xcoordinate of the image pickup object gravity center G is set to themiddle point in the horizontal direction, that is, to the X coordinate(160) same as that of the vertical reference line Ld1, that is, thereference point P.

In this instance, the horizontal offset amount Δx defined as the amountof movement of the image pickup object gravity center G in thehorizontal direction with reference to the vertical reference line Ld1is set to 0.

FIG. 19 illustrates the image pickup object gravity center G (160,−120+Δy) set in accordance with such rules and algorithm of thecomposition decision as described above.

After all, the process of adjusting the composition from the state ofFIG. 18 to the state of FIG. 19 is a process of moving the center ofgravity of the face of an image pickup object into a predeterminedtarget range by pan-tilt operations and setting the size of the imagepickup object to an appropriate size by a zoom operation. Then, thetarget range is set in response to the size, number, direction of theface and so forth of such image pickup objects SBJ.

For example, in the case of FIG. 19, since the face is directedforwardly, a target range TA is set as seen in FIG. 20A, and the imagepickup object gravity center G is included in the target range TA.

In response to the setting of the target range TA, the horizontal offsetamount Δx and the vertical offset amount Δy are determined, and thecomposition adjustment is carried out so that the image pickup objectgravity center G is finally included in the target range TA.

While FIG. 20A shows the target range TA where the face direction of theimage pickup object SBJ is the forward direction, depending upon thedirection of the face, the target range TA is set in a different manner.

For example, it is assumed that the detected face direction of the imagepickup object is the leftward direction. It is to be noted here that theleftward face direction here signifies a direction of the face in astate in which, where the picture contents of the picture range 300 areviewed actually, to a person who watches the picture range 300, the faceof the image pickup object SBJ looks directed to the left side on thepicture range 300. Incidentally, actually the person itself of the imagepickup object SBJ is directed to the right side where the direction inwhich the person opposes to the image pickup apparatus by which theimage of the person was picked up is the forward direction.

In this instance, as regards the position of the image pickup objectgravity center G in the horizontal direction, it is positioned, frombetween two left and right image regions or divisional regions intowhich the region of the picture range 300 is divided by the verticalreference line Ld1, in the “right” image region on the opposite side tothe “left” indicated by the face direction. Consequently, in the picturerange 300, a space is obtained on the left side toward which the face ofthe image pickup object SBJ is directed.

In short, the target range TA is set to the right side image region withrespect to the vertical reference line Ld1 as seen in FIG. 20B. Then,the image pickup object gravity center G is moved into the target rangeTA.

By setting the composition in such a manner as described above, a betterresult is obtained, for example, in comparison with another compositionwherein the image pickup object is positioned such that the image pickupobject gravity center G of the image pickup object SBJ whose facedirection is the leftward direction corresponds to or coincides with thecenter of the screen in the leftward and rightward direction or afurther composition wherein the target range TA is set to the left sideimage region with respect to the vertical reference line Ld1.

On the other hand, where the detected face direction of the image pickupobject is the rightward direction, the image pickup object gravitycenter G is set to the left side image region from between the two leftand right divisional image regions split by the vertical reference lineLd1 conversely to that in the case in which the detected face directionis the leftward direction.

Further, where a plurality of image pickup objects are detected, animage region including the plural detected image pickup objects areregarded as a single integrated image pickup object, and a single imagepickup object gravity center GG, that is, a single integrated imagepickup gravity center GG, is determined from the integrated image pickupobject.

For example, FIG. 21A illustrates an example wherein two image pickupobjects SBJ1 and SBJ2 are detected. The center of gravity of the gravitycenters G1 and G2 of the image pickup objects SBJ1 and SBJ2 becomes anintegrated image pickup object gravity center GG12.

It is assumed that the target range TA is set to a position shown inFIG. 21A from the number, direction of the face and size of the imagepickup objects.

In this instance, the composition adjustment is carried out in such amanner that the integrated image pickup object gravity center GG12 isincluded in the target range TA as indicated by an arrow mark.

As a result, such a composition as shown in FIG. 21B is obtained.

The image pickup object gravity center G can be set in several differentmanners. FIGS. 21A and 21B illustrate the simplest example of suchsetting wherein the middle point of a line segment interconnecting thecenters (G1 and G2) of gravity of those ones of a plurality of detectedimage pickup objects which are positioned on the most left side and themost right side within the picture range 300 is set as the integratedimage pickup object gravity center GG12.

Where a plurality of image pickup objects are involved, the facedirections individually detected from the individual image pickupobjects are sometimes different from each other. In this instance, oneface direction of the integrated image pickup object may be determinedbased on the relationship of the face directions detected for theindividual image pickup objects. As the relationship of the facedirections detected for the individual image pickup objects, where thenumber of same face directions occupies more than a predetermined ratein the total number of image pickup objects, the same face direction isdetermined as the face direction of the integrated image pickup objectand is used for the composition setting and the setting of the targetrange TA.

As can be recognized from the foregoing description, the target range TAin which the image pickup object gravity center or the integrated imagepickup object gravity center is to be disposed is determined from thesize, number and direction of image pickup objects. Then, whether or notthe composition is optimum is decided depending upon whether or not theimage pickup object gravity center or the integrated image pickup objectgravity center is included in the target range TA. Also, whether or notthe image pickup object size is optimum is determined.

Then, if it is decided that the composition is not optimum, then as aprocess for the composition adjustment, the position of the image pickupobject gravity center G is changed so that the image pickup objectgravity center or the integrated image pickup object gravity center maybe included in the target range TA, or the image pickup object size isvaried so as to be appropriate.

The variation of the position of the image pickup object gravity centerG or the integrated image pickup object gravity center GG is carriedout, in regard to the horizontal direction, by pan control for the panmechanism of the camera platform 10. On the other hand, in regard to thevertical direction, the variation is carried out by tilt control for thetilt mechanism of the camera platform 10.

The variation of the image pickup object size is carried out by controlfor moving the zoom lens of the optical system section 21 of the digitalstill camera 1, that is, by zoom control. Alternatively, the variationmay be carried out by such an image signal process as image cutting outfor picked up image data.

The basic composition process is such as described above. For example,in the case of the process of FIG. 12, such processes as described aboveare carried out by the composition process at step F3 of FIG. 11A in theautomatic image pickup mode at step E102.

However, when control of moving the image pickup object gravity center Ginto the target range TA described above is carried out, even if anoptimum composition is obtained within the image pickup visual field atthe point of time, actually there is a case in which a more appropriatecomposition exists.

For example, although a plurality of persons exist in the neighborhood,a composition is adjusted with a smaller number of persons and maypossibly be different from a composition for a maximum number ofpersons.

An example is shown in FIG. 22.

Referring to FIG. 22, an image pickup visual field indicated by apicture range 300A is an optimum composition as a local solution. Inparticular, if two image pickup objects SBJ1 and SBJ2 are detected bythe image pickup object detection process although three persons arepositioned in the neighborhood, the integrated image pickup objectgravity center GG12 of the two image pickup objects SBJ1 and SBJ2 isincluded in the target range TA, that is, in the picture range 300A.

However, in this instance, the image pickup visual field as the bestsolution is such as shown as a picture range 300B. In particular, theintegrated image pickup object gravity center GG123 of the three personsof the image pickup objects SBJ1, SBJ2 and SBJ3 is included in thetarget range TA of the picture range 300B.

If such a search that tilting up is carried out from below in theprocedure of the image pickup object detection process and two imagepickup objects SBJ1 and SBJ2 are detected first, then a compositionprocess is carried out only with the two image pickup objects SBJ1 andSBJ2 and still picture image pickup is carried out with the compositionas the local solution.

Also FIG. 23A similarly shows a picture range 300A where the compositionis a local solution and another picture range 300B where the compositionis the best solution.

If it is assumed that such a search that a pan operation proceeds fromthe left to the right in the procedure of the image pickup objectdetection process and two image pickup objects SBJ1 and SBJ3 aredetected first, then a composition process is carried out only with thetwo image pickup objects SBJ1 and SBJ3. Therefore, still picture imagepickup is carried out with the composition as a local solution.

For example, in the case of image pickup in the automatic image pickupmode, even if still picture image pickup is carried out with thecomposition as the local solution, there is no serious trouble. This isbecause the user carries out image pickup without being conscious of it.

However, in the request responding image pickup mode, the composition asthe local solution is likely to be different from a demand of the user.

For example, it is assumed that three users gather so as to have aphotograph of them taken and carry out trigger inputting. In thisinstance, although a commemorative photograph of the three persons isdemanded, in the state of the local solution, a situation occurs thatone of the three persons is not included in the photograph. Where it isintended to include a number of persons as great as possible in aphotograph, it is necessary to look around once.

Thus, as an example, the composition process in the request respondingimage pickup mode includes a process of moving, when one or more imagepickup objects in accordance with an image pickup request are detectedwithin an image pickup visual field, the image pickup visual field toconfirm presence of some other image pickup object in accordance withthe image pickup request.

As a particular example, as the composition adjustment process, twostages of processing including tentative composition adjustment andregular composition adjustment are carried out.

The tentative composition adjustment is a process for searching whetheror not there exists some other image pickup object before pan-tiltoperations to a composition which is a target as a regular compositionare carried out upon composition adjustment. For example, the tentativecomposition adjustment is a process of carrying out pan-tilt operationsso that the pan-tilt amounts intentionally exceed the target range TA ofthe regular composition to search whether or not there exists some otherimage pickup object.

An actual process is carried out by changing the target range TA betweenthe tentative composition adjustment and the regular compositionadjustment.

The tentative composition adjustment is described with reference FIGS.24A and 24B.

FIG. 24A shows an example wherein three image pickup objects SBJ1, SBJ2and SBJ3 of persons exist. Here, it is assumed that the image pickupobjects SBJ1 and SBJ2 of two persons are detected in a procedure oftilting from below to above in the image pickup object detectionprocess.

Here, the composition process is entered, and first, the tentativecomposition adjustment is carried out.

In this instance, the target range TA is set to a lower position incomparison with that in the case of normal composition adjustmentdescribed hereinabove in the picture range 300 as shown in FIG. 24A.

First, since the image pickup objects SBJ1 and SBJ2 are detectedalready, in the composition adjustment, pan-tilt control is carried outsuch that the integrated image pickup object gravity center GG12 of theimage pickup objects SBJ1 and SBJ2 is included in the target range TA.In the case of the present example, tilt up is carried out in order thatthe integrated image pickup object gravity center GG12 may be includedin the target range TA.

However, in this instance, since the target range TA is set to a lowerposition in comparison with that in the case of normal setting, the tiltup amount is greater than that in the case of the normal compositionadjustment and tilt up is carried out further upwardly.

Then, the image pickup object SBJ3 is newly detected in the procedure.

In this instance, the composition process is carried out again inresponse to the detection of the image pickup objects SBJ1, SBJ2 andSBJ3. In this case, tentative composition process is carried out first.Now, tilt up is carried out so that the integrated image pickup objectgravity center GG123 of the image pickup objects SBJ1, SBJ2 and SBJ3 isincluded in the target range TA.

Then, if no other image pickup object exists above the image pickupobject SBJ3, then the tentative composition adjustment is completedafter all as seen in FIG. 24B.

If the tentative composition adjustment is completed, then the regularcomposition adjustment is carried out subsequently. The regularcomposition adjustment here signifies the normal composition adjustmentdescribed hereinabove.

FIG. 25A illustrates the picture range 300 in a state in which thetentative composition adjustment is completed. When the regularcomposition adjustment is to be carried out, the target range TA is setto a normal position shown in FIG. 25A. In particular, in this instance,the target range TA used in the tentative composition adjustment isre-set to an upper portion in the picture range 300.

Then, pan-tilt control is carried out so that the integrated imagepickup object gravity center GG123 is included in the target range TA.In this instance, tilt down control is carried out.

Then, a state illustrated in FIG. 25B is established, and since theintegrated image pickup object gravity center GG123 is included in thetarget range TA, the regular composition adjustment is completed.

After all, an optimum composition including the image pickup objectsSBJ1, SBJ2 and SBJ3 of three persons is obtained at the time ofcompletion of the regular composition adjustment.

For example, in the tentative composition adjustment, the target rangeTA is set to a position different from a normal position in accordancewith a searching direction upon the regular composition adjustment,particularly to a position within the picture range 300 on this sidewith respect to the variation direction of image pickup visual field asdescribed above. Consequently, the target range TA is positioned once ata position a little beyond the position of the composition to which itshould be adjusted finally. It is confirmed thereby whether or not thereexists some other image pickup object within a range in the searchingdirection.

Since, in the examples shown in FIGS. 24A to 25B, tilt up issuccessively carried out upon tentative composition adjustment, thetarget range TA upon tentative composition adjustment is set lower incomparison with the normal position.

If it is assumed that a pan operation is carried out from the right tothe left upon tentative composition adjustment and the target range TAin the regular composition is placed on the vertical reference line Ld1,then the target range TA upon tentative composition adjustment is placedon the right side with respect to the vertical reference line Ld1 asshown in FIG. 26A. Consequently, it can be confirmed whether or notthere exists some image pickup object on the further left side.

Further, if it is assumed that panning is carried out from the left tothe right upon tentative composition adjustment and the target range TAin the regular composition is placed on the vertical reference line Ld1,then the target range TA upon tentative composition adjustment is placedon the left side with respect to the vertical reference line Ld1 asshown in FIG. 26B. Consequently, it can be confirmed whether or notthere exists some image pickup object on the further right side.

In this manner, by setting the target range TA different from that inthe regular composition adjustment to carry out the tentativecomposition adjustment and thereafter carrying out the regularcomposition adjustment, pickup of a still picture image can be carriedout without missing of an image pickup object. In other words, pickup ofa still picture wherein a maximum number of image pickup objects aretargeted can be carried out.

It is to be noted that, where the detected face of a certain imagepickup object overlaps with an end region of the picture region in theprocedure of pan-tilt operations in the tentative compositionadjustment, also a process that no further pan-tilt process is carriedout can be used.

Further, even if the center of gravity varies depending upon thedirection of the face upon regular composition adjustment, also it seemsa possible idea to ignore the direction of the face upon tentativecomposition adjustment.

Further, while a representative example of an image pickup object is theface of a person, where a noticed region other than the face of a personsuch as an image pickup object SJB4 in FIG. 23B can be extracted, alsoit seems a possible idea to combine the face of a person and such anoticed region as just described to carry out composition adjustment.

A process where the tentative composition adjustment is applied to theprocess in FIG. 12 is described with reference to FIGS. 27A to 28B.

FIG. 27A illustrates an image pickup object detection process and acomposition process carried out at steps F2 and F3 in FIG. 11A whenoperation of the automatic image pickup mode is carried out at step F102in FIG. 12.

Here, while the tentative composition adjustment is not carried out inthe composition process in the automatic image pickup mode, an exampleof a process wherein the tentative composition adjustment is carried outis described as an example wherein an algorithm different from that ofthe composition process of the automatic image pickup mode is adopted inthe request responding image pickup mode.

First, as the image pickup object detection process at step F2 in theautomatic image pickup mode described with reference to FIG. 11A, thecontrol section 27, particularly the image pickup preparation processingsection 82, confirms whether or not an image pickup object is detectedat step F201 in FIG. 27A.

If an image pickup object is not detected, then the control section 27,particularly the image pickup preparation processing section 82,executes a searching process at step F202. Then, the control section 27confirms whether or not an image pickup object is detected at step F201.

In particular, in the processes at step F201 and F202, the controlsection 27, particularly the image pickup preparation processing section82 and the image pickup view field variation control section 83, carryout pan-tilt control for the camera platform 10 and carry out zoomcontrol for the optical system section 21 to confirm whether or notimage pickup object detection by image analysis by the signal processingsection 24 or the control section 27 is carried out while varying theimage pickup visual field.

If an image pickup object is detected, then the control section 27,particularly the image pickup preparation processing section 82, carriesout, as the composition process at step F3 in FIG. 11A, confirmationregarding whether or not an optimum composition is obtained at step F203and a process of composition adjustment at step F204 in FIG. 27A.

This is the normal composition process described above, and is theprocess described, for example, with reference to FIGS. 18 to 21B.

In particular, decision of a picture structure, particularly decision ofthe number of image pickup objects in the picture range, the imagepickup object size and the direction of the face and so forth, based ona result of the image pickup object detection is carried out. Then, itis decided in accordance with a predetermined algorithm whether or notan optimum composition is obtained based on the information of thepicture structure decided by the picture structure decision. On theother hand, if an optimum composition is not obtained, then, as thecomposition adjustment, the image pickup visual field is varied by pan,tilt and zoom control.

It is to be noted that, as described hereinabove with reference to FIG.11A, where pan-tilt and zoom control is carried out in the compositionadjustment, the processing is carried out again beginning with the imagepickup object detection process at step F2 from step F3. In an exampleof FIG. 27A, where the composition adjustment is carried out at stepF204, the process is carried out again from step F201.

The composition adjustment at step F204 is carried out similarly to thenormal composition adjustment process.

An example of a procedure of normal composition adjustment isillustrated in FIG. 28A.

Referring to FIG. 28A, first at step F300, the control section 27 setsthe target range TA for obtaining an optimum composition. For example,the target range TA is set as shown in FIG. 20A or 20B.

Then at step F301, the control section 27 decides a horizontal offsetamount Δx in response to the set target range TA.

Then at step F302, the control section 27 executes pan control so thatthe image pickup object gravity center G or the integrated image pickupobject gravity center GG is positioned at an X-coordinate correspondingto the decided horizontal offset amount Δx.

Then, at step F303, the control section 27 decides a vertical offsetamount Δy for the target range TA. Then, at step F304, the controlsection 27 executes tilt control so that the image pickup object gravitycenter G or the integrated image pickup object gravity center GG ispositioned on a Y-coordinate corresponding to the decided verticaloffset amount Δy.

Then, at step F305, the control section 27 decides a zoom magnificationZ.

As described above, size variation of the image pickup object SBJ in thepicture range 300 is carried out by varying the picture angle by zoomcontrol. Here, the zoom magnification signifies a magnification of thepicture angle necessary for obtaining an image pickup object sizedecided in response to an optimum composition from an image pickupobject size when an image pickup object is detected by the image pickupobject detection process.

Therefore, the control section 27 first decides a target image pickupobject size, that is, a zoom control target value, necessary for anoptimum composition in accordance with a predetermined rule in responseto a condition of the detected image pickup object.

Then, the ratio between the target image pickup object size size_trgdetermined as described above and the image pickup object size size_org,which is a size or a number of pixels of one side in the verticaldirection or in the horizontal direction of a face framework FR, iscalculated and then the calculated ratio is determined as the zoommagnification Z. Particularly, the zoom magnification Z is calculated bythe following expression:Z=size_trg/size_(—) org

Then, at step F306, the control section 27 executes zoom control withthe zoom magnification Z.

The procedure of the composition adjustment illustrated in FIG. 28A isan example to the end. For example, after zoom control is carried outfirst, pan-tilt control may be carried out. Further, the horizontaloffset amount Δx and vertical offset amount Δy can be calculated alsotaking size variation of an image pickup object by the zoommagnification into consideration.

In the automatic image pickup mode, the composition process is carriedout as described with reference to FIGS. 27A and 28A.

On the other hand, the composition process executed at step F107 in FIG.12 in the request responding image pickup mode is carried out in thefollowing manner.

FIG. 27B illustrates the image pickup object detection process and thecomposition process to be carried out at steps F106 and F107 in FIG. 12in the request responding image pickup mode.

First, as the image pickup object detection process at step F106, thecontrol section 27, particularly the image pickup preparation processingsection 82, confirms at step F201 whether or not an image pickup objectis detected.

If an image pickup object is not detected, then the control section 27,particularly the image pickup preparation processing section 82,executes a search process at step F202. Then, the control section 27confirms whether or not an image pickup object is detected at step F201.

The processes as steps F201 and F202 are similar to those at steps F201and F202 in FIG. 27A, respectively.

If an image pickup object is detected, then the control section 27,particularly the image pickup preparation processing section 82, carriesout a process of a tentative composition first as the compositionprocess at step F107 of FIG. 12. In particular, at step F210, processesof confirmation regarding whether or not an optimum composition state asa tentative composition is obtained and tentative composition adjustmentare carried out at step F211. The processes just described are similar,for example, to those described hereinabove with reference to FIGS. 24Ato 26B.

In particular, decision of a picture structure, that is, decision of thenumber, size, the direction of the face and so forth of image pickupobjects, based on a result of the image pickup object detection, iscarried out, and then a target range TA for a tentative composition isdetermined. Then, it is decided whether or not an optimum composition asa tentative composition is obtained, and, if an optimum composition isnot obtained, then the image pickup visual field is varied by pan-tiltand zoom control as tentative composition adjustment.

It is to be noted that, also where pan-tilt and zoom control is carriedout as the tentative composition adjustment, the processing returns tostep F201 and then image pickup object detection is carried out again.This is because there is the possibility that an image pickup object maydisappear by variation of the image pickup visual field or movement ofthe user.

Further, since, in such tentative composition adjustment as describedabove, the image pickup visual field is moved by a greater amount thanthat in the normal composition adjustment, there is the possibility thata new image pickup object may be detected. In this instance, thetentative composition adjustment is carried out again based on the imagepickup object gravity center G or the integrated image pickup objectgravity center GG including the new image pickup object.

An example of a procedure of the tentative composition adjustment atstep F211 is illustrated in FIG. 28B.

Referring to FIG. 28B, the control section 27 sets a target range TA forobtaining a tentative composition at step F310. For example, asdescribed with reference to FIGS. 24A and 24B and 26A and 26B, a targetrange TA different from an original target range TA is set in responseto a search direction.

Processes at steps F311 to F316 after step F310 are similar to those atsteps F301 to F306 of FIG. 28A for the normal composition adjustment.

In particular, at step F311, the horizontal offset amount Δx is decidedin response to the set target range TA for the tentative composition.

Then, at step F312, the control section 27 executes pan control so thatthe image pickup object gravity center G or the integrated image pickupobject gravity center GG may be positioned on the X-coordinatecorresponding to the horizontal offset amount Δx.

Then, at step F313, the control section 27 decides the vertical offsetamount Δy with respect to the target range TA for the tentativecomposition. Then, at step F314, the control section 27 executes tiltcontrol so that the image pickup object gravity center G or theintegrated image pickup object gravity center GG may be positioned onthe Y-coordinate corresponding to the vertical offset amount Δy.

Then, at step F315, the control section 27 decides the zoommagnification Z.

Then, at step F316, the control section 27 executes zoom control withthe zoom magnification Z.

Also the procedure of the tentative composition adjustment in FIG. 28Bis an example to the end. For example, pan-tilt control may be carriedout after zoom control is carried out. Further, the horizontal offsetamount Δx and the vertical offset amount Δy can be calculated takingalso the size variation of the image pickup object by the zoommagnification into consideration.

If such tentative composition adjustment as described above is carriedout and OK decision is obtained with regard to the tentative compositionat step F210 in FIG. 27B, or in other words, if the image pickup objectgravity center G or the integrated image pickup object gravity center GGis positioned within the target range TA for the tentative composition,then processes of the actual composition at steps F212 and F213 arecarried out. In particular, the normal composition adjustment is carriedout.

The processes of the regular composition at steps F213 and F213 aresimilar to those at steps F203 and F204 in FIG. 27A, respectively.Further, the procedure of the regular composition adjustment at stepF213 is carried out, for example, in such a manner as illustrated inFIG. 28A.

As described above, in the request responding image pickup mode, twostages of the composition process including the tentative compositionadjustment and the regular composition adjustment are carried out.

Consequently, an image wherein a maximum number of persons are set asimage pickup objects within the range of the view angle and which isdemanded by the user can be automatically picked up as a still picturepicked up image demanded by the user.

It is to be noted that, while, as the method of the tentativecomposition adjustment, an example wherein the target range TA is set onthe near side as viewed from the searching direction is described, someother particular method may be applied.

For example, it seems a possible idea to carry out, when an image pickupobject is detected, tentative composition adjustment based on the imagepickup object and then carry out search around the image pickup objectto confirm whether or not some other image pickup object exists. Or, anexample may be used that, when an image pickup object is detected,search around the image pickup object is carried out simply.

5-7. Control Method in a Different Request Responding Image Pickup Mode

While various examples are described above as the modifications to thefirst embodiment, they are directed to the image pickup preparationprocess or the image pickup object detection process in the image pickuppreparation process and the composition process which are carried out,particularly in the request responding image pickup mode, by controlmethods different from those used in the automatic image pickup mode.

In addition to the examples described above, in the request respondingimage pickup mode, various control methods based on a processingprocedure, an algorithm, setting of a control parameter and so forthwhich are different from those in the automatic image pickup mode areavailable.

In the request responding image pickup mode, for example, also asituation in which a plurality of users gather and request image pickupof a still picture of them can be assumed. In this instance, in order topick up an image of users as many as possible, it may occur that thezoom control range in the composition processing procedure must belimited. In particular, an upper limit parameter for zoom control ischanged.

Also it may possibly occur to set the decision condition for an optimumcomposition tolerant. For example, in the request responding imagepickup mode, the range of the framework of the target range TA isexpanded.

Or, the period of time within which the image pickup object gravitycenter G exists within the target range TA may be set short. Forexample, while it is decided at steps F203, F210 and F212 in FIGS. 27Aand 27B that, if the image pickup object gravity center G exists withinthe target range TA for a period of time longer than a predeterminedperiod of time, then the composition is OK, where the processes at stepsF210 and F212 are carried out in the request responding image pickupmode, the predetermined time period is set shorter.

The foregoing arises from the fact that, since the processes describedabove are carried out in accordance with image pickup based on therequest by the user, it is anticipated that the user side moves only alittle.

Further, it seems a possible idea to limit, in the image pickup objectdetection process at step F106 in FIG. 12 in the request respondingimage pickup mode, the panning range and the tilting range in order tomake it easy to detect the requested user. This is a technique forpreventing that, where the position of the requesting user is known bysome degree, for example, where the direction of the request describedabove can be recognized, a different user from the user who issued therequest is determined as an image pickup object.

6. Image Pickup Operation of the Second Embodiment

Image pickup operation control of a second embodiment is illustrated inFIG. 29.

Referring to FIG. 29, the image pickup operation control illustratedincludes steps F101 to F107 and F109 similar to those describedhereinabove with reference to FIG. 12, and overlapping description ofthe processes at the common steps is omitted herein to avoid redundancy.

In the present second embodiment, where the request responding imagepickup mode is entered, after the control section 27 carries out theimage pickup object detection process at step F106 and the compositionprocess at step F107, it carries out a release operation without issuinga release prediction.

For example, if OK decision regarding the composition process isobtained at step F107, then the control section 27, particularly themode sequence control section 86, carries out a release timing decisionprocess as step F108A as indicated by a solid line in the flow chart ofFIG. 29.

Then, when arrival of a release timing is decided, the processingadvances to step F109, at which a release process is carried out. Afterthe release process, the processing returns to the automatic imagepickup mode process at step F102.

The release timing decision process is a process for deciding whether ornot a predetermined still picture image pickup condition is satisfied,and various examples can be applied.

For example, release timing decision based on time is applicable. Forexample, lapse of predetermined period of time such as, for example, twoor three seconds from a point of time at which OK decision regarding thecomposition process is obtained is determined as a still picture imagepickup condition. In this instance, the control section 27, particularlythe mode sequence control section 86, carries out counting of apredetermined period of time at step F108A. Then, if the predeterminedperiod of time elapses, then the control section 27 executes the releaseprocess under the control of the picked up image recording controlsection 81 at step F109.

Further, when a particular sound input is detected, it may be decidedthat the still picture image pickup condition is satisfied.

For example, a particular word uttered from a user, sound by clapping ofhands, sound of a whistle or the like may be used as the particularsound as the still picture image pickup condition.

The control section 27, particularly the mode sequence control section86, carries out input detection of such particular sounds at step F108A.

Then, if any of such particular sounds is confirmed from a result of theinput sound signal analysis from the sound inputting section 35, then itis decided that a release timing is reached, and a release process isexecuted under the control of the picked up image recording controlsection 81 at step F109.

Or, when a particular image pickup object state is detected from apicked up image, it may be decided that the still picture image pickupcondition is satisfied.

The control section 27, particularly the mode sequence control section86, supervises presence/absence of the particular image pickup objectstate detected by the analysis of the picked up image at step F108A.

The particular image pickup object state may be a particular expressionsuch as a smile of an image pickup object caught by the compositionprocess, a particular gesture such as, for example, waving of a handtoward the image pickup system, raising of a hand, clapping of hands ora behavior such as making of a V-sign or winking at the image pickupsystem. Or, the particular image pickup object state may be gazing of auser of an image pickup object at the image pickup system.

The control section 27 decides any of the particular states of the userby an image analysis process of the picked up image. Then, if aparticular image pickup object state is detected, then it is decidedthat the release timing comes, and a release process is executed underthe control of the picked up image recording control section 81 at stepF109.

It is to be noted that, while, in the present second embodiment, therelease prediction process is not carried out, when the release timingdecision is carried out at step F108A, preferably the release predictionoperation is executed to urge the user to carry out an actioncorresponding to the still picture image pickup condition such as, forexample, a smile or generation of voice.

Further, as another process example, the processing may advanceimmediately to step F109 after the composition process as indicated by abroken line in FIG. 29 to carry out the release process.

It is to be noted that, also to the present second embodiment, thevarious examples described as the modifications to the first embodimentcan be applied as modifications.

7. Image Pickup Operation of the Third Embodiment

An example of processing of a third embodiment is illustrated in FIG.30.

Also the process example of FIG. 30 includes steps F101 to F105 and F108to F109 similar to those of FIG. 12, and overlapping description of themis omitted herein to avoid redundancy.

In the present third embodiment, when the request responding imagepickup mode is entered in response to a trigger input, the image pickupobject detection process and the composition process as the image pickuppreparation process are not carried out, but release prediction iscarried out immediately at step F108. Thereafter, release operation iscarried out at step F109.

The process of steps F108 and F109 is similar to that of FIG. 12.

As one of cases in which the user wants to establish the requestresponding image pickup mode, the user may intend to carry out stillpicture image pickup in a state of the image pickup visual field of thedigital still camera 1 at this time.

In such an instance, particularly the image pickup object detectionprocess and the composition process may be unnecessary.

For example, when the image pickup visual field of the digital stillcamera 1 is automatically varying in the automatic image pickup mode,the user carries out trigger inputting at a timing at which the digitalstill camera 1 is directed to the user itself. Then, in this state, arelease prediction operation is carried out to carry out still pictureimage pickup.

Also by such processing, still picture image pickup satisfying therequest of the user is implemented.

It is to be noted that, also to the third embodiment, the variousexamples described as the modifications to the first embodiment, thatis, the examples, for example, of the trigger input other than the imagepickup object detection process and the composition process, can beapplied as modifications.

Particularly in the case of the present third embodiment, also it ispreferable to combine the operations described hereinabove withreference to FIG. 13 as a modification to the first embodiment, that is,the requested direction decision at step F120 and the pan-tilt controlin the requested direction at step F121 of FIG. 13.

In this instance, when the user carries out trigger inputting, thedigital still camera 1 is turned to the direction of the user first, andin this state, the release prediction and release processes are carriedout.

8. Image Pickup Operation of the Fourth Embodiment

A fourth embodiment is described as an example of processing in theautomatic image pickup mode.

FIG. 11B illustrates the example of processing of the fourth embodiment.

Referring to FIG. 11B, the process example includes steps F1 to F3similar to those of FIG. 11A. In this instance, if a composition processis decided OK at step F3, then a release prediction process is carriedout at step F4A. The release prediction process in this instance issimilar to that described hereinabove in connection with the process atstep F108 of FIG. 12.

In short, the present fourth embodiment is a process example wherein,also upon still picture image pickup in the automatic image pickup mode,a release prediction process is carried out and the user is notifiedthat still picture image pickup is carried out.

This process can be applied also to an image pickup system which doesnot include the request responding image pickup mode, and the process ofFIG. 11B can be applied as the automatic image pickup mode at step F102of FIG. 12.

Also in the automatic image pickup mode, if a release prediction processis carried out, then the user may take notice of this and can take apose while being conscious of the still picture image pickup.

9. Modifications to the Functional Configuration

While process examples of several embodiments have been described, theyare control processes basically based on the functional configurationdescribed hereinabove with reference to FIG. 10.

For example, the image pickup system including the digital still camera1 and the camera platform 10 can have various other functionalconfigurations. In the following, several examples are described.

FIG. 31 shows an example of an image pickup system which includes afunction as a trigger detection/acceptance section 87 provided on thecontrol section 27 side of the digital still camera 1 as can berecognized from comparison with FIG. 10. In particular, detection of atrigger input is carried out by the control section 27 side, and if atrigger input is detected, then it is accepted as a trigger to therequest responding image pickup mode.

In the modifications to the first embodiment, various examples of thetrigger input are described. For example, in a case in which a touchsensor is provided on the housing of the digital still camera 1, inanother case in which trigger inputting is carried out as an operationto the digital still camera 1 or in some other case, the triggerdetection/acceptance section 87 of the control section 27 functions torecognize the trigger input as seen from FIG. 31.

Also where the sound inputting section 35 shown in FIG. 8 is providedand a particular sound input is recognized as a trigger input, thetrigger detection/acceptance section 87 shown in FIG. 31 carries out arecognition process of the particular sound input.

Further, where the control section 27 on the digital still camera 1 sideincludes a function as the trigger detection/acceptance section 87, thefunction recognizes, in the procedure of image analysis by the signalprocessing section 24, that is, of the image pickup object detectionprocess, a behavior, the eyes and so forth as the particular imagepickup object state described hereinabove to carry out detection of atrigger input.

From the foregoing, such a functional configuration as shown in FIG. 31may be adopted.

Naturally, both of the trigger detection section 73 on the cameraplatform 10 side shown in FIG. 10 and the trigger detection/acceptancesection 87 on the digital still camera 1 side shown in FIG. 31 may beprovided as functional configuration elements so that various triggerinputs may be accepted.

As another example of the functional configuration, through not shown,the release prediction operation control section 84 shown in FIG. 10 or31 may be provided on the camera platform 10 side.

In other words, the release prediction execution section 64 may beprovided on the camera platform 10 side as shown in FIG. 9 or anoperation as a prediction may be executed by pan-tilt operations of thecamera platform 10.

In this instance, the mode sequence control section 86 provides aninstruction for a release prediction operation to the release predictionoperation control section on the camera platform 10 side bycommunication. In response to the instruction, the release predictionoperation control section controls execution of operation of the releaseprediction execution section 64 or controls execution of a predeterminedbehavior by pan-tilt operations.

FIG. 32 shows an example wherein the digital still camera 1 includesonly the picked up image recording control section 81 and thecommunication processing section 85. Meanwhile, the camera platform 10side, particularly the control section 51, includes the communicationprocessing section 71, trigger detection/acceptance section 79, imagepickup preparation processing section 74, image pickup visual fieldvariation control section 75, release prediction operation controlsection 76 and mode sequence control section 77.

While the functional sections described carry out control processesbasically similar to those described hereinabove with reference to FIG.10, the control processes are different in the following points.

The image pickup preparation processing section 74 receives supply ofpicked up image data as frame images from the signal processing section24 of the digital still camera 1 in order to carry out an image pickupobject detection process and a composition process. Then, the imagepickup preparation processing section 74 carries out image analysis andthen carries out an image pickup object detection process and acomposition process similar to those described hereinabove.

The image pickup visual field variation control section 75 controls thepan driving section 55 and the tilt driving section 58 to executepan-tilt operations for image pickup object detection and compositionadjustment in accordance with an instruction from the image pickuppreparation processing section 74.

Further, for zoom control, the image pickup preparation processingsection 74 outputs a control signal to the control section 27,particularly to the picked up image recording control section 81, on thedigital still camera 1 side through the communication processing section71. The picked up image recording control section 81 executes a zoomprocess for composition adjustment in accordance with the zoom controlsignal.

The mode sequence control section 77 issues instructions to theassociated functional sections in order to implement, for example, theoperations in the automatic image pickup mode and the request respondingimage pickup mode illustrated in FIG. 12 or the like.

When a release process at step F109 of FIG. 12 or the like is to becarried out, the mode sequence control section 77 outputs a releasecontrol signal to the control section 27, particularly to the picked upimage recording control section 81, of the digital still camera 1 sidethrough the communication processing section 71. The picked up imagerecording control section 81 controls execution of still picturerecording operation in response to the release control signal.

The trigger detection/acceptance section 79 detects a trigger input.Then, when a trigger input is detected, the trigger detection/acceptancesection 79 accepts the trigger input as a trigger to the requestresponding image pickup mode.

Further, when a release prediction process is to be carried out, themode sequence control section 86 issues an instruction for a releaseprediction operation to the release prediction operation control section76. In response to the instruction, the release prediction operationcontrol section 76 controls execution of operation of the releaseprediction execution section 64 on the camera platform 10 side orcontrols execution of a predetermined behavior by pan-tilt operations.

It is to be noted that, as a modification to the example of FIG. 32,though not shown, the release prediction operation control section maybe provided on the digital still camera 1 or on both of the cameraplatform 10 and the digital still camera 1.

In other words, execution of trigger inputting or a release predictionoperation is executed by the digital still camera 1 side, or by thecamera platform 10 side or else by both of the digital still camera 1side and the camera platform 10 side.

FIG. 33 shows a further modification to the example of FIG. 32. Thepresent modification corresponds to the case in which the image pickupsection 63 is provided on the camera platform 10 side as mentionedhereinabove with reference to FIG. 9.

The image pickup preparation processing section 74 inputs frame imagedata not from the digital still camera 1 side but from the image pickupsection 63. Then, the image pickup preparation processing section 74carries out image analysis and then carries out an image pickup objectdetection process and a composition process similar to those describedhereinabove.

Also in this instance, the image pickup visual field variation controlsection 75 controls the pan driving section 55 and the tilt drivingsection 58 to execute pan-tilt operations for image pickup detection andcomposition adjustment in accordance with an instruction from the imagepickup preparation processing section 74 similarly as in the example ofFIG. 32. Further, for zoom control, the image pickup preparationprocessing section 74 outputs a zoom control signal to the controlsection 27, particularly to the picked up image recording controlsection 81, on the digital still camera 1 side through the communicationprocessing section 71. The picked up image recording control section 81controls execution of a zoom process for composition adjustment inaccordance with the zoom control signal.

Further, since the image pickup section 63 is provided on the cameraplatform 10 side, the camera platform 10 can cope also with a particularimage pickup object state, that is, also with a trigger input by aparticular behavior, the eyes or the like of the user.

To this end, the trigger detection/acceptance section 79 analyzes pickedup image data from the image pickup section 63 to detect a triggerinput. Then, when a trigger input is detected, the triggerdetection/acceptance section 79 accepts the detected trigger input as atrigger to the request responding image pickup mode.

It is to be noted that, also in the modification of FIG. 33, the triggerdetection section or the release prediction operation control sectionmay be provided on the digital still camera 1 or on both of the cameraplatform 10 and the digital still camera 1.

Or, the trigger detection section may be provided on the digital stillcamera 1 side while the trigger acceptance section is provided on thecamera platform 10 side.

An example is shown in FIG. 34. Referring to FIG. 34, the digital stillcamera 1, particularly the control section 27, includes the picked upimage recording control section 81, the communication processing section85 and a trigger detection section 88. Meanwhile, the camera platform10, particularly the control section 51, includes the communicationprocessing section 71, a trigger acceptance section 78, the image pickuppreparation processing section 74, the image pickup visual fieldvariation control section 75, the release prediction operation controlsection 76 and the mode sequence control section 77.

For example, where a touch sensor is provided on the housing of thedigital still camera 1, where the sound inputting section 35 is providedor in a like case, a user operation or a particular sound input on thedigital still camera 1 side is detected by the trigger detection section88. Then, a trigger detection is transmitted to the trigger acceptancesection 78 on the camera platform 10 side through the communicationprocessing sections 85 and 71. The trigger acceptance section 78 carriesout acceptance of the trigger input through the communication andnotifies the mode sequence control section 77 that a trigger input isreceived. The mode sequence control section 77 issues instructions tothe associated functional sections to implement, for example, operationsin the automatic image pickup mode and the request responding imagepickup mode described hereinabove with reference to FIG. 12 or the like.

While several configuration examples of the control functions aredescribed, naturally further various configurations of the controlfunctions are possible.

The most basic functional configuration according the present embodimentis such as shown in FIG. 35A or 35B.

FIG. 35A shows a configuration wherein at least the mode sequencecontrol section 86 and the trigger acceptance section 89 or the triggerdetection/acceptance section 87 are provided on the digital still camera1 side. Various examples are possible wherein the other functionalsections are provided on the digital still camera 1 side or the cameraplatform 10 side. For example, such a configuration as shown in FIG. 10or 31 is one of such examples.

FIG. 35B shows a configuration wherein at least the mode sequencecontrol section 86 and the trigger acceptance section 78 or the triggerdetection/acceptance section 79 are provided on the camera platform 10side. Various examples are possible wherein the other functionalsections are provided on the digital still camera 1 side or the cameraplatform 10 side. For example, such a configuration as shown in FIG. 32,33 or 34 is one of such examples.

As can be recognized from the foregoing, the image pickup controlapparatus of the present embodiment can be implemented also as a controlfunction configuration as the digital still camera 1 and can beimplemented also as a control function configuration of the cameraplatform 10. Further, the image pickup control apparatus can beimplemented also as a control function configuration of an image pickupsystem including the digital still camera 1 and the camera platform 10.In other words, the digital still camera 1, the camera platform 10 andthe image pickup system including the digital still camera 1 and thecamera platform 10 can each be applied as an image pickup controlapparatus or a production for carrying out an image pickup controlmethod of the present embodiment.

It is to be noted that, while the control function sections areindividually shown as blocks in FIGS. 10, 31 to 34 and 35A and 35B, theyneed not be formed as individually independent program modules orhardware components. In fact, only it is necessary for the controlfunction sections to implement such processing operations as describedhereinabove with reference to FIG. 12 and so forth as general processesof the control function sections.

10. Program

A program according to the present embodiment causes a processor such asa CPU to execute the processes in the automatic image pickup mode andthe request responding image pickup mode as processing operations of theembodiments and the modifications described hereinabove. Particularly,the program implements the processes described hereinabove withreference to FIG. 12 and so forth by being started up by the controlsection 27 or 51.

The program can be recorded in advance in a HDD (Hard Disk Drive) as arecording medium built in such an apparatus as a personal computer, thedigital still camera 1 or the camera platform 10, a ROM in amicrocomputer having a CPU and so forth.

Or, the program may be stored or recorded temporarily or permanently onor in a removable recording medium such as a flexible disk, a CD-ROM(Compact Disc Read Only Memory), an MO (Magnet-Optical) disk, a DVD(Digital Versatile Disc), a blu ray disk, a magnetic disk, asemiconductor memory or a memory card. Such a removable recording mediumas just mentioned can be provided as package software.

Or, the program may be installed from a removable recording medium intoa personal computer or the like or may be downloaded from a downloadsite through a network such as a LAN (Local Area Network) or theInternet.

The program of the present embodiment is suitable for implementation andwide-range provision of an image pickup apparatus and an image pickupsystem which implement the processes of the embodiments describedhereinabove.

It should be understood by those skilled in the art that variousmodifications, combinations, sub-combinations and alterations may occurdepending on design requirements and other factors insofar as they arewithin the scope of the appended claims or the equivalents thereof.

What is claimed is:
 1. An image pickup control apparatus, comprising:circuitry configured to: accept a predetermined trigger to change froman automatic image pickup mode to a request responding image pickupmode; and operate, upon determination that an input of the predeterminedtrigger is accepted while an image pickup apparatus performs a firstimage pickup operation with a first image pickup visual field of theimage pickup apparatus changed in the automatic image pickup mode, theimage pickup control apparatus in the request responding image pickupmode in which the image pickup apparatus is controlled to execute aprocess for determining a second image pickup visual field in accordancewith an image pickup request from a user and subsequently execute asecond image pickup operation after the determination of the secondimage pickup visual field, wherein: in the automatic image pickup mode,the image pickup apparatus automatically performs the first image pickupoperation regardless of the image pickup request from the user and basedon detection by the circuitry of at least one first predeterminedcondition within the first image pickup visual field; and the secondimage pickup visual field is determined only based on detection by thecircuitry of at least one second predetermined condition within thesecond image pickup visual field.
 2. The image pickup control apparatusaccording to claim 1, wherein the second image pickup operation capturesa still image corresponding to the second image pickup visual field. 3.The image pickup control apparatus according to claim 2, wherein the atleast one first predetermined condition and the at least one secondpredetermined condition are the same.
 4. The image pickup controlapparatus according to claim 2, wherein the at least one firstpredetermined condition and the at least one second predeterminedcondition are different.
 5. The image pickup control apparatus accordingto claim 1, wherein the at least one first predetermined conditionincludes presence of a predetermined pickup object and predeterminedcomposition criteria.
 6. The image pickup control apparatus according toclaim 1, wherein the circuitry is configured to operate the image pickupcontrol apparatus in the automatic image pickup mode after the secondimage pickup operation is performed.
 7. The image pickup controlapparatus according to claim 1, wherein the first image pickup visualfield of the image pickup apparatus is a visual field that correspondsto a still image acquired by the first image pickup operation.
 8. Theimage pickup control apparatus according to claim 1, wherein the secondimage pickup visual field includes an image of the user who issued theimage pickup request.
 9. A method of an image pickup control apparatusfor changing an image pickup mode, the method comprising: accepting apredetermined trigger to change from an automatic image pickup mode to arequest responding image pickup mode; and operating, by circuitry of theimage pickup control apparatus and upon determination that an input ofthe predetermined trigger is accepted while an image pickup apparatusperforms a first image pickup operation with a first image pickup visualfield of the image pickup apparatus changed in the automatic imagepickup mode, the image pickup control apparatus in the requestresponding image pickup mode in which the image pickup apparatus iscontrolled to execute a process for determining a second image pickupvisual field in accordance with an image pickup request from a user andsubsequently execute a second image pickup operation after thedetermination of the second image pickup visual field, wherein: in theautomatic image pickup mode, the image pickup apparatus automaticallyperforms the first image pickup operation regardless of the image pickuprequest from the user and based on detection by the circuitry of atleast one first predetermined condition within the first image pickupvisual field; and the second image pickup visual field is determinedonly based on detection by the circuitry of at least one secondpredetermined condition within the second image pickup visual field. 10.A non-transitory computer-readable storage medium storing instructionswhich, when executed by a computer, cause the computer to perform amethod of an image pickup control apparatus for changing an image pickupmode, the method comprising: accepting a predetermined trigger to changefrom an automatic image pickup mode to a request responding image pickupmode; and operating, by the computer and upon determination that aninput of the predetermined trigger is accepted while an image pickupapparatus performs a first image pickup operation with a first imagepickup visual field of the image pickup apparatus changed in theautomatic image pickup mode, the image pickup control apparatus in therequest responding image pickup mode in which the image pickup apparatusis controlled to execute a process for determining a second image pickupvisual field in accordance with an image pickup request from a user andsubsequently execute a second image pickup operation after thedetermination of the second image pickup visual field, wherein: in theautomatic image pickup mode, the image pickup apparatus automaticallyperforms the first image pickup operation regardless of the image pickuprequest from the user and based on detection by the circuitry of atleast one first predetermined condition within the first image pickupvisual field; and the second image pickup visual field is determinedonly based on detection by the circuitry of at least one secondpredetermined condition within the second image pickup visual field.